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This  study  is  concerned  with  detailed  expansions  for  the  renewal 
function  H(t)  and  various  of  its  generalizations.  Our  assumptions 
concerning  the  growth  rate  of  the  tail  of  the  underlying  lifetime 

distribution  F(x)  are  of  tlie  form  x'^M(x)dF(x)  < where 

•*0 

V s 0 and  M(x)  belongs  to  an  appropriate  class  of  monotone  functions. 
IVhen  F(x)  has  a finite  variance,  it  is  shown  that  (for  t > 0) 


"(t)  1 • ‘-(t). 
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where  denotes  the  ith  moment  of  F(x) , f second 

derived  distribution  of  F(x),  and  L(t)  is  a function  of  bounded 

variation  such  that,  in  particular,  L(t)  = o(l/tM(t))  as  t -►  ®.  A 

similar  expression  for  H(t)  involving  a finite  number  of  derived 

distributions  is  derived  for  the  infinite  variance  case.  In  addition 

our  approach  yields  refined  expansions  for  the  factorial  moments  and 

cumulants  of  the  number  of  renewals  in  the  time  interval  (0,t).  By 

developing  estunates  for  the  moments  of  the  forward  recurrence 

we  can  also  evaluate  the  variance  of  the  number  of  renewals  Irt  an 

> 52J 

interval  of  time  away  from  the  origin.  ^ 

' * “i 

Our  main  task  throughout  is  to  demonstrate  that  various  remainder'* 

* * 

terms  are  functions  B{x)  of  bounded  variation  belonjlng’to  ;-j, 

r'  y A ■ ^ 

|x|^  I ' 

act  I ' 

For  this  purpose  we  prove  an  extension  of  a theorem  due  tp  Wienef,  Pit! 

I J 

Lc*vy,  and  Smith  concerning  analytic  functions  of  Fouflgr-Tlrtritj^s-— 
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I ' j 'tran^fohnS'' oT  ^im^ons  in  6(M;  v) ; our  version  is  the  most  general 

,t  I which  can  be  obtAii^  with  respect  to  M(x) . We  also  demonstrate  that 

i ' • 

- certain  convolutions  which  might  be  presumed  to  belong  to  8(M;  0)  are 
actually  in  8{M;  1).  In  conjunction  with  the  Wiener-Pitt -Levy-Smith 
result  this  unexpected  property  (referred  to  as  "smoothing  magic") 
yields  renewal  theoretic  results  which  are  stronger  than  can  be 
achieved  using  the  former  alone. 

Several  of  these  theorems  are  applied  in  a discussion  of  the  time- 
dependent  behavior  of  the  superposition  of  identical  independent 
renewal  processes.  Aspects  considered  include  the  distribution  of  the 
nimber  of  events  in  a time  interval  near  the  origin,  as  well  as  the 
variance-time  and  covariance -time  functions. 
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CHAPTER  I:  INTRODUCTION 


The  purpose  of  this  study  is  to  develop  detailed  exi)ansions  for 
the  renewal  function  and  various  of  its  generalizations.  Tlie  renewal 
function  (which  we  write  as  ll(t))  is  defined  as  follows:  Suj^pose 
that  is  a sequence  of  positive  iid  random  variables  with 

distribution  function  F(x).  The  random  variables  may  be  regarded 

as  the  lifetunes  of  similar  objects  which  are  successively  and  instan- 
taneously replaced;  in  other  words,  renewals  take  place  at  "tines" 

Xp  Xj^X^,  Xj+X^+Xj and  so  on.  Then  , the  ntonber  of  renewals 

by  time  t,  is  the  largest  integer  k such  that 


Xi  + Xz  + Xj^  t , 


and  H(t)  = by  definition.  It  is  not  difficult  to  show  that 

oo 

U(t)  = [ PiXj+Xz^  ...  ^ t}. 

n*l 

The  renewal  function  occurs  in  a variety  of  useful  probability 
models  and  has  been  studied  extensively  by  many  authors.  The  most 
fundamental  and  earliest  result  concerning  H{t)  is  the  Elementary 
Renewal  Theorem  v^ich  states  that 


^ . 1-  as  t * 
t u, 

where  ■ EX^  and  the  limit  1/uj  is  interpreted  as  zero  if 

Uj  * ♦<*>.  The  first  rigorous  proof  of  the  Elementary  Renewal  Theorem 


is  due  to  Feller  (1941)  who  made  use  of  a Tauberian  theorem  for  Laplace 
transforms . 


llie  development  of  renewal  theory  since  1941  has  proceeded  along 
two  parallel  lines,  deper^ding  on  whether  the  random  variables  Xj  are 
assumed  to  be  lattice  or  non-lattice.  Feller  (1949)  introduced  the 
theory  of  recurrent  events  for  the  situation  in  which  the  random  variables 
Xj  arc  restricted  to  (say)  the  integers;  a recurrent  event  E is  said 
to  occur  at  times  X^,  Xj+X^,  ....  and  u^  is  defined  as  the  expected 
numl)er  of  occurrences  of  E at  time  n.  Erdos,  F'eller,  and  Pollard 
(1949)  proved  that 


(1.0.1) 


1 

u — as  n ^ 00 
n pj 


under  an  aperiodicity  condition.  Using  (1.0.1)  Feller  (1949)  showed 
that 


(1.0.2) 
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u. 
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provided  Ut  “ EX.  < ou.  Various  generalizations  of  (1.0.1)  and  (1.0.2) 
^ J 

have  been  obtained  since  1949,  each  involving  some  assumption  aliout  the 

sequence  f^  - P{Xj-n),  n ■ 0,1,2 These  results  are  too  nunerous 

to  review  here;  for  a thorough  discussion  of  the  theory  of  recTirrent 
events  based  on  a unified  approach  we  refer  the  reader  to  the  stud>' 


by  Smith  (1976) . 

The  present  work  is  concerned  with  the  theory  of  renewals  which 

differs  from  that  of  recurrent  events  only  in  that  the  random  variables 

X.  are  not  restricted  to  a lattice  of  values.  There  u corresjwnds 
J ^ 

to  the  expected  number  of  renewals  in  the  time  interval  (t,  t+1];  this 


can  be  written  as  H(t+1)  - H(t)  and  is  known  as  the  Blackwell  dif- 
ference. Blackwell  (1948)  proved  the  following  analogue  of  (1.0.1): 
For  any  fixed  a > 0, 


3 


(1.0.3)  H(t+a)  - H(t) 


as  t -*  «>. 


Later  we  shall  refer  to  the  following  important  generalization  of 
(1.0.3): 

KEY  RENEWAL  THEOREM  (Smith,  1961;  page  498)  Suppose  that  the  distn- 
bution  F(x)  ie  non-lattiae  and  that  k(x)  is  Riemann-integrable  in 
every  finite  interval  and 


I max  |k(x) 
n=-oo  n<xsn+l 


k(x-z)dH(z) 


^ r 

"1  'o 


k(z)dz 


as  X where  the  right-hand  side  is  interpreted  as  zero  if 


A consequence  of  the  Key  Renewal  Theorem  is  the  following  extension 
of  the  Elementary  Renewal  Theorem: 


SECOND  RENEWAL  THEOREM  (Smith,  1954)  Suppose  F(x)  ie  continuous  and 


• P x^dF(x)  < ® . 


li,  - x‘-dF(x) 
^ In 
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Then 


(1.0.4) 


H(t) 


— 2 

2u] 


^ 0(1) 


t -►  ■». 


ITie  Second  Renewal  Theorem  is  a prototype  of  the  results  which  we 
shall  derive;  our  concern  will  be  to  develop  approximate  formulae  for 
H(t)  (and  several  of  its  extensions)  involving  rmainder  terms  which 
tend  to  zero  as  t -►  «>.  The  rate  of  convergence  for  sudi  terms 
typically  follows  from  the  analytical  proi)erties  imjxDsed  on  I (x),  and 
we  shall  make  two  kinds  of  assumptions  concerning  the  underlying  distri- 
bution. 

First,  for  technical  reasons,  it  will  be  necessary  to  assume  that 
F(x)  possesses  a certain  amount  of  smoothness,  although  certainly  not 
as  much  as  absolute  continuity.  In  fact,  we  shall  merely  require  that 
some  iterated  convolution  of  F(x)  possess  an  absolutely  continuous 
component . 

Hewever  our  main  assumptions  will  deal  with  the  growth  rate  of  the 
tail  of  the  distribution  F(x) . This  rate  can  be  expressed  in  various 
ways  involving,  for  example,  "o"  or  "0"  terms  of  functions  of  slov,’ 
growth.  (A  detailed  discussion  of  such  conditions  in  the  recurrent 
events  situation  is  given  by  Smith  (1976).)  Here  we  dioose  to  measure 
growth  rate  by  allowing  for  the  existence  of  moments  of  a fairly 
general  nature  as  follows: 

x'Vl(x)dF(x)  < ®. 


r 

* f\ 


(1.0.5) 
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Note  that  (1.0.5)  implies,  in  particular,  that 


1 - F(x) 


^x^(x) 


as  X -♦  oo. 


It  will  be  necessary  to  restrict  the  choice  of  M(x)  to  one  of  two 
classes  of  monotone  functions;  we  refer  to  these  families  as  M and 
M*.  Roughly  speaking,  functions  in  M*  grow  like  polynomials.  The 
class  M contains  M*  and  is,  in  a sense,  the  most  inclusive  family 
with  which  we  can  deal.  Apparently  Smith  (1967)  introduced  the 
systematic  use  of  moment  classes  in  renewal  theory,  and  since  then 
other  authors  have  employed  slightly  different  families  of  monotone 
functions. 

Our  two  basic  results  concerning  the  renewal  function  are  given  in 
Chapters  2 and  4.  The  first  (Theorem  2.4)  provides  an  expansion  for 
the  renewal  function  in  the  finite  variance  case,  i.e.,  when  (1.0.5) 
can  be  assumed  for  v 2 2 and  M(x)  e M.  Theorem  2.4  sharjiens  the 
Second  Renewal  Theorem  by  replacing  the  remainder  term  "o(l)"  with 
a known  function  and  a new  remainder  term  which  is  of  the  order 
o(l/tM(t)).  The  latter  is,  in  fact,  shown  to  be  a function  of  bounded 
variation  satisfying  a condition  similar  to  (1.0.5).  The  form  of  the 
expansion  in  Theorem  2.4  is  not  new;  an  ancestral  version  is  disguised 
in  the  addendum  to  the  paper  by  Smith  (1967).  However  our  result  is 
slightly  more  general  in  terms  of  the  moment  class  used  and  is  actually 
the  best  which  can  be  achieved  via  our  particular  approach. 

Our  second  result  (Theorem  4.6)  concerning  the  renewal  function 
deals  with  the  situation  where  F(x)  possesses  an  infinite  variance 
but  satisfies  (1.0.5)  for  v * 1 > 6 with  0 <■  6 < 1.  The  expansion 


6 


for  MCx)  in  this  case  is  far  more  complicated  thaji  in  the  previous 
one,  and  the  analysis  required  is  likewise  more  detailed.  The  main 
task  in  proving  Theorem  4.6  is  (again)  to  demonstrate  that  a certain 
remainder  term  is  a function  of  bounded  variation  satisfying  an 
integrabi lity  property  like  (1.0. S).  Theorem  4.6  is  the  renewal 
theoretic  analogue  of  a result  due  to  .Stone  iuid  Wainger  (1067)  and 
considerably  generalizes  subsexjuent  work  by  Duhman  (1970). 

In  Chapters  5 and  6 we  extend  our  investigation  to  higher  moments 
of  the  renewal  counting  process  N^.  Chapter  5 is  concerned  with 
detailed  expansions  for  the  factorial  moments 

*^(t)  = 1:|(N^*1)(.N^^2)  ...  (N^>k)}, 

defined  for  k = 1,2,3, Ihese,  in  turn,  yield  information  about 

the  cunuilants  of  N^,  thus  refining  results  obtained  by  Smith  (1959), 
as  well  as  allowing  for  more  general  moment  conditions.  Our  expressions 
for  the  second  and  third  cumulants  of  are  presented  in  closed  form, 

and  we  indicate  an  approach  for  dealing  with  higher  order  cumulants. 
However  further  work  (perhaps  of  a combinatoric  nature)  will  be  required 
in  order  to  evaluate  in  a direct  fashion  the  constants  involved  in  the 
higher  order  situations. 

An  interesting  question  related  to  the  problem  of  finding  the 
variance  of  is  that  of  evaluating  the  variance  of  the  number  of 

renewals  in  an  interval  of  time  caxiy  ffom  the  origin.  This  involves 
the  moments  of  the  forward  recurrence- time  which  is  defined  as 

the  time  measured  forward  from  t to  the  next  renewal,  estimates  for 
E[c^]  are  discussed  in  Chapter  6,  and  specific  results  obtained  for 
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LjCj.]  and  are  used  to  study  variance-t imc  and  covariance- time 

functions. 

ITie  mathematical  tools  which  we  use  throughout  our  work  are 
described  in  Section  2.1.  ilieorem  2.1  (due  to  Smith  (1967))  provides 
detailed  information  about  the  remainder  term  in  the  Taylor  expaitsion 
for  characteristic  functions.  In  order  to  deal  with  functions  of 
characteristic  functions  Smith  (1967)  developed  a modification  of  a 
well-known  result  due  to  Wiener,  Levy,  and  Pitt  which,  in  its  original 
form,  states  that  the  reciprocal  of  a non-vanishing  function  with  an 
absolutely  convergent  Fourier  series  [xissesses  an  absolutely  convergent 
Fourier  series.  ITieorem  2.2,  which  is  an  extension  of  Smith's  theorem, 
concerns  analytic  functions  of  functions  in  the  class  8^(M;  u) , which 
is  defined  as  the  Banach  algebra  of  Fourier-Stielt jes  transforms  of 
functions  B(x)  of  bounded  variation  such  that 


|x|^  M(lx|) |dB(x) I 


< on 


for  fixed  v ? 0 and  M(x)  e M.  The  proof  of  Theorem  2.2  (which  is 
largely  based  on  recent  work  done  by  Smith  (1976))  is  contained  in  the 
Appendix.  The  key  element  in  both  the  proof  and  the  application  of 
Theorem  2.2  is  a device  referred  to  as  a emooth  mutilator  funotion, 
which  bears  some  resemblance  to  the  test  functions  used  in  the  theory 
of  generalized  distributions. 

In  order  to  establish  certain  results  in  renewal  theory  via  the 
"Wiener-Pitt-Levy-Smith  approach"  we  must  frequently  demonstrate  first 
that  some  Fourier-Stieltjes  transform  belongs  to  a particular  class 
8^(M;  v) . Suppose,  for  instance,  that  F(x)  is  a distribution  function 
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satisfying;  (1.0.5)  for  v = 2 and  some  M(x)  . M.  Then  its  I-'ourier- 
Stieltjes  triinsform  (which  we  write  as  l'^(W))  belongs  to  B^(M;  2). 
If  we  form  the  first  derived  distribution  of  F(xJ , defined  as 


(1.0. b) 


(X) 


fx 

o 


I-F(u) 


du, 


where  Uj  is  the  first  moment  of  l-(x)  , then  ^ member 

of  S^(M;  1)  rather  than  S^(M;  2).  In  transform  notation  (1.0.6) 
is  written  as 


-MjiO 


and  we  can  interpret  the  "loss"  of  one  whole  moment  as  the  price  to  be 
paid  for  dividing  by  -i0.  (In  fact,  this  effect  is  generally  a conse- 
quence of  applying  the  "integration  operator"  l/(-id)  to  a bourier- 
Stieltjes  transform.)  Now  suppose  we  convolve  U(x)  - f^)(x)  with 
itself,  where  U(x)  is  the  Heaviside  unit  function;  clearly 


(1  - ‘ 1)  . 


and  one  might  naturally  conclude  in  view  of  the  above  tliat 


(1.0.7) 


[1 


8*(M; 


0) 


-i9 


Surprisingly  it  can  be  shown  (see  Leirma  2.3)  that  the  transform  (1.0.7) 
belongs  to  the  class  8^(M;  1);  in  other  words,  the  convolution  in  the 
numerator  of  (1.0.7)  has  the  unexpected  effect  of  causing  a "lost" 
moment  to  "reappear." 
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ITiis  property,  which  we  refer  to  as  nmoothing  magic,  plays  a vital 
role  throughout  Chapters  2,  4,  5,  and  h.  In  conjunction  with  the 
Wiener-Pitt-Levy-Smith  1 1 leorem .smoothing  magic  yields  renewal  theoretic 
results  which  are  much  stronger  than  can  be  obtained  by  using  Theorem 
2.2  alone.  Two  extensions  of  the  smoothing  magic  effect  are  discussed 
in  Sections  4.3  and  5.2.  We  suspect,  moreover,  that  these  may  them- 
selves be  s|)ecial  cases  of  some  even  more  general  property  of  convolu- 
tions such  as  (1.0.7). 

An  afiplication  of  one  of  our  main  results  (Theorem  2.4)  is  given 
in  Chajiter  3 which  deals  with  an  aspect  of  the  t ime- dependent  behavior 
of  the  sufieqjosit  ion  of  identical  inuc|x;ndent  renewal  prcx;esses.  This 
problem  originally  provided  the  motivation  for  studying  detailed 
expansions  for  the  renewal  function.  Suppose  that  the  sources  in  the 
superposition  consist  of  N renewal  processes,  each  with  underlying 
distribution  F(x)  and  corresponding  first  moment  Then  the 

probability  that  no  event  in  the  (scaled)  superjxisition  occurs  during 
(t^,  tjj  AtJ  is  given  by 


P 

o 


p^(t^*At)/N 


P,t„/N 


Assuming  N is  small,  if  the  superposition  has  not  reached  equilibrium 
by  time  t , then  P involves  the  behavior  of  the  renewal  function 
M(x)  for  only  moderately  large  values  of  x.  By  using  Theorem  2.4  it 
is  possible  to  obtain  fairly  sharp  estimates  for  P^  and  related 
probabilities.  The  discussion  of  the  suj^erposition  application  is 
resumed  in  Chapters  5 and  6,  where  we  derive  approximations  for  the 
corresponding  variance- time  and  covariance- time  functions.  The  variance- 
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time  curve  has  been  used  for  statistical  analysis  of  siq)erposition 
(see  Cox  and  Lewis  (1966)),  and  it  is  conceivable  that  our  work  may 
lead  to  improved  results  in  this  direction. 


CHAPTER  II:  SOME  PRELIMIHARY  RENEWAL  THEORY 


The  purpose  of  this  chapter  is  to  review  some  ideas  and  techniques 
related  to  the  problem  of  characterizing  the  remainder  term  in  a parti- 
cular type  of  expansion  for  the  renewal  function.  Our  basic  model  is  a 
sequence  randan  variables  with  distribution  functicai 

F(x)  and  corresponding  renewal  function  defined  as 

00 

H(x)  = y P{X,  X S x}. 

n=l 

For  the  applications  we  propose  in  Chapter  3,  it  is  entirely  reasonable 
to  assume  X^  is  noi-negative,  although  the  discussion  that  follows 
belcw  will  extend  to  unrestricted  random  variables.  In  Section  2.2  we 
examine  the  asymptotic  behavior  of  H(x)  as  x -►  ® when  F(x)  has  a 
finite  variance;  a study  of  the  infinite  variance  situation  will  be 
taken  up  in  Chapter  4. 

2.1  Some  Basic  Tools 

The  notation  and  methods  which  we  follow  are  largely  based  on  a 
lengthy  paper  by  Smith  (1967)  which  appeared  in  the  Proceedings  of  the 
Fifth  Berkeley  Symposiun.  The  systematic  approach  developed  in  this 
work  incorporates  a nuni>er  of  features  which  are  essential  to  our 
discussion  in  subsequent  chapters. 

Although  a density  is  often  assumed  for  F(x)  in  applications,  we 
shall  obtain  results  under  considerably  weaker  conditions.  Consequently 
we  shall  refer  to  the  following  classes  of  distribution  functions: 
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T:  distributions  with  a nonnull  absolutely  continuous  component, 

C:  distributions  r(x)  such  that,  for  some  k,  the  kth 

iterated  convolution  of  F(x)  is  in  T, 

U:  distributions  F(xJ  whose  I'ourier-Stieltjes  transform 

F^(e)  satisfies  Cramer's  Conditicm  C:  lim  inf|l-F^(0)|  > 0. 

|g I “ 

It  is  not  difficult  to  show  that  T c C c u. 

The  growth  rate  of  the  tail  of  the  distribution  F(x)  will  play  a 
critical  role  in  our  results.  A key  concept  eTnjJloyed  by  Smith  (1967) 
is  the  notion  of  a moment  class  of  monotone  functions.  Smith  introduced 
the  class  M*  of  functions  M(x)  satisfying  the  following  conditions: 

(1)  M(x)  is  nondecreasing  in  [0,®), 

(2)  M(x)  i 1 for  all  x > 0, 

(3)  M(x-*-y)  s M(x)M(y)  for  all  x,  y 2 0, 

(4)  M(2x)  - OCM(x))  for  all  x > 0. 

l?(M;v)  will  be  used  to  denote  the  class  of  distribution  functions  F(x) 
such  that  for  some  moment  functioji  M(x)  and  some  v 2 0, 

|xr  MClx|)dF(x)  < ® . 

• 00 

3/2 

A typical  M*  function  is  M(x)  asymptotically  equal  to  x 'log  x; 
a sp)ecial  M*  function  is  I(x)  = 1.  Note  that  if  M(x)  e M*,  then  so 
is  x°‘M(x)  where  a i 0.  Condition  (3)  ensures  that  P{M;  v) 
will  be  closed  under  convolusion.  Note  tlwt  Condition  (4) 
excludes  functicxis  which  groM  exponentially  fast,  such  as  M(x) 
asymptotically  equal  to  exp{x/(log  x) } and  exj){x*}  for  0 < 6 s 1. 

In  fact,  if  M(x)  e M*  tlien  M(x)  • 0(x®)  as  x -*  ® for  some  large  B. 
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Various  authors  have  introduced  similar  classes  of  monotone  functiwis; 
see,  for  instance.  Stone  and  Wainger  (1967),  Smith, (1969) , Essen  (1973), 
Chover,  Ney,  and  Wainger  (1973),  and  Smith  (1976).  In  a recent  study  of 
the  theory  of  recurrent  events  Smith  (1976)  replaced  Condition  (4)  with 
the  less  restrictive  requirement 


(4')  For  every  fixed  h > 0,  M(x+h)  ~ M(x)  as  x -►  «>. 


Functions  in  this  class,  which  we  shall  denote  by  M,  are  referred  to  by 
Smith  as  right  moment  functions. 

A function  T(x)  (not  necessarily  in  M)  which  satisfies  (4')  is 
said  to  be  a function  of  moderate  grouth  and  has  the  canonical  representa- 
tion 


(2.1.1)  T(x) 


as  X -►  oo. 


where  a(u)/u  ->0  as  u -►  ® and  b(x)  -►I  as  x ®.  Recall  that 
functions  of  slow  growth  have  the  Karamata  representation  (2.1.1)  v4iere 
a(u)  ■♦0  as  u -►  ®;  functicais  of  regular  variation  are  characterized  by 
the  requirement  that  a(u)  -»  p as  u -►  <*>,  where  p is  positive  and 
finite.  T(x)  is  a function  of  moderate  growth  iff  T(log  x)  is  a 
function  of  slow  growth. 

The  advantage  to  be  gained  by  adopting  M rather  than  M*  is  that 

we  are  able  to  include  functions  which  grow  asymptotically  like 
1/2 

exp{x  ' } and  exp{x/(log  x)}.  However  our  approach  will  necessitate 
what  Smith  (1976)  has  labelled  the  Umbrella  Condition  U: 


This  excludes  functions  which  grow  asymptotically  like  e*. 
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The  membership  requirements  for  M are  essentially  asymptotic. 
Smith  (1969,  1976)  jxjinted  out  that  M may  be  extended  to  the  class  of 
functions  N(x)  sudi  that  for  some  M(x)  satisfying  (1)  through  (4') 


above,  both  N(x)/M(x)  and  M(x)/i\'(x)  are  bounded  as  x -*■ 

Throughout  our  work  we  shall  write  L(M;  v)  for  the  class  of 
functions  f(x)  such  that  for  some  v s 0 and  M(x)  in  some  specified 


class , 


|x|^  M(|x|)  I f(x)  |dx  < <». 


Likewise  B(M;  v)  will  denote  the  class  of  functions  B(x)  of  bounded 
variation  satisfying 


M(|x|)|dB{x)| 


< «>. 


tquivalently,  functions  in  8(M,  v)  are  finite  (con^lex)  linear  combi- 
nations of  distributions  functions  in  P(M;  v) . 

If  f(x)  is  in  an  L-class  we  write  f ' (6)  e^®^  f(x)dx  for  its 

Fourier  transform.  If  B(x)  is  in  a 6-class  we  write  B^{e)  » 

i0x 

J_^e  dB(x)  to  denote  its  Fourier -St ieltjes  transform.  This  "dagger” 
notation  will  be  applied  in  an  obvious  way  to  classes  of  ^tfictions;  for 
example,  the  class  of  characteristic  functions  of  distributions  in  P(M;  v) 
will  be  written  as  P^(M;  v) . 

A main  feature  of  the  Smith  (1967)  approach  is  a theorem  which 
provides  detailed  information  about  the  remainder  term  in  the  Taylor 
expansion  for  a characteristic  function.  This  result  is  adumbrated  by  a 
similar  result  of  Smith  (1959)  concerning  the  Taylor  expansion  for  the 
Laplace-Stieltjes  transform  of  a distribution  function,  and  it  has  found 
applications  elsewhere  in  probability  theon'.  Because  wc  shall  need  to 
refer  to  the  later  result,  the  relevant  portion  is  reproduced  here: 
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l'Hi:ORl:M  2.1  (Smith,  1967;  page  270)  Let  F(x)f  P{I ; ^)  for  some  t > 0, 
and  let  k 2 0 be  the  greatest  integer  not  exceeding  t. 

(a)  When  t is  not  an  integer,  ue  cun  choose  any  real  constant 
c and  have 

F^(9)  - 1 ♦ [ ^ (ie)-*  > |e|^  e^*^  V(0) 

j-1  j! 

Dhere  is  the  moment  of  F(x)  and  s^(0)  c L^(I;  0). 

(b)  If  £ 2 1 and  r is  any  integer,  1 < r s £,  for  any 
F^(0)  € P^(M;  t)  we  have 


F^(0) 


1 ♦ I -j-  (i0)j  ♦ t'''(0) 

j*l  j!  r! 


where  t^(0)  e 5^(M;  £-r)  is  the  Fouri.er  transform  of  some 
function  t^(x)€lL(r  ;0)  such  that  t^(0)  = and 

|t^(x)  |dx  « r jxl’^  dF(x) . 

I — qo 

When  r is  even,  or  if  r is  odd  and  F(x)  refers  to  a non- 
negative random  variable,  t*^(0)  = y F^  . (0)  , whexv 

1 I ^ ' 

dV  (M;  £-r).  in  any  case,  t^(0)  is  expressible  as 
the  linear  combination  of  two  characteristic  functions,  one  of 
which  corresponds  to  a positive  random  variable  and  the  other 
to  a negative  one. 


We  note  that  the  original  proof  of  Theorem  2.1  given  by  Smith  (1967)  uses 
only  conditions  (1)  through  (3)  for  M(x)  e M*  and  consequently  suffices 
for  M(x)  £ M. 

The  distribution  function  F^^j(x)  referred  to  in  Theorem  2.1  is 
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th 

known  as  the  r derived  dietribution  and  can  be  written  explicitly  in 
terms  of  F(x).  A crucial  consequence  of  Theorem  2.1  is  that  r whole 
moments  are  "lost"  in  goinj;  from  F(x)  to  Fj^^j(x).  F^^j  (x)  is 
absolutely  continuous,  and  we  shall  write  fj^j,^(x)  for  the  corresponding 
r^  derived  density.  Derived  distributions  are  strikingly  apposite  to 
renewal  tlieory;  they  were  first  used  by  Smith  in  his  1953  Cambridge  Ph.D. 
dissertation,  aixi  Theorem  2.1  was  foreshadowed  in  results  obtained  by 


Smith  (1959). 


Authors  have  typically  analyzed  the  behavior  of  the  renewal  function 
by  assuming  a particular  moment  condition  for  F(x)  and  deriving  an 
expression  for  H(x)  which  involves  a remainder  term  of  the  "o"  or  "0" 
type  or  a function  of  slo^r  growth.  The  methods  employed  are  generally 
ad  hoc.  A well  known  example  is  the  Second  Renewal  Theorem  which  states 
that  if  F(x)  is  continuous  ajid  has  a finite  variance,  then 

P- 


H{x) 


- * \ 
Pi  I 


'2 


- 1 


* o(l)  as  X 


Following  the  systematic  approach  developed  by  Smith  (1967) , we 
shall  be  concerned  with  proving  that  remainder  terms  belong  to  specific 
8-classes.  A nimber  of  results,  including  the  more  familiar  kinds  of 
estimates,  can  then  be  deduced  from  this  stronger  type  of  conclusion. 

The  cornerstone  of  this  approach  is  a variation  of  a well-known 
theorem  due  to  Wiener,  Pitt,  and  Levy.  In  its  simplest  form  the  original 
result  states  that  the  reciprocal  of  a nonvanishing  function  with  an 
absolutely  convergent  Fourier  series  possesses  an  absolutely  convergent 
Fourier  series;  see  page  91  of  Wiener  (1933).  Smith  (1967)  sharpened  the 
Wiener-Pitt-L^  theorem  in  order  to  deal  with  fxaictions  of  Fourier- 
Stieltjes  transform  of  functions  of  bounded  variation.  Following  a 
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functional  analytic  approach  Chovcr,  Ney,  and  Wainijcr  (1973)  modified  the 
Wiener-Pitt-Levy  theorem  to  obtain  results  with  applications  in  tlie 
theory  of  branching  processes. 

Both  these  modifications  are  included  in  a very  comprehensive  versicffi 
of  the  Wiener-Pitt-Levy  result  developed  by  Smith  (1976)  for  Fourier 
series.  Much  of  our  work  will  depend  on  t)ie  Fourier-Stieltjes  analogue 
of  a portion  of  ITieorem  3.1  of  Smith  (1976).  Since  absolute  continuity 
will  be  an  issue,  some  additional  notation  is  required:  If  (p(e)  is  a 
characteristic  function,  write  1 - 3[())(9)]  for  the  total  weight  of 
probability  in  the  absolutely  continuous  component  of  the  corresponding 
distribution.  Define 

p[4.(9)]  = inf  {3[{(».(9)}^]}^^'^  . 
k 

In  particular  p[(|)(9)]  < 1 if  ())(9)  « C^. 

We  now  state  the  version  of  the  Wiener-Pitt-Levy  theorem  which  will 
be  invoked  later. 

Theorem  2.2  (Wiener-Pitt-Levy-Smith)  Suppose  that  41(9)  and  iK9) 
belong  to  8^(M;  v)  for  some  MCx)  e M and  some  v > 0,  and  assume 
that  4'(0)  vanishes  identically  outside  an  interval  J.  Furthermore, 
suppose  that  as  9 runs  through  J»  the  point  2 = 4)(9)  maps  out  an 
arc  C in  the  complex  plane  and  that  'J>(z)  is  analytic  at  every  point 
of  C. 

(A)  If  J is  a compact  interval  then  >^(9)<l>(<(i(9))  e 8^(M;  v) . 

(B)  If  J is  an  infinite  or  semi-infinite  interval  and 

i|/(e)  € P^CM;  v) , then  i|<(0)'K<(i(0) ) c 6^(M;  v)  , provided  no 
singularity  of  ♦(z)  is  within  a distance  pl<)>(0))  of  the 
origin. 
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The  proof  of  Theorem  2.2  is  essentially  contained  in  the  two  papers 
by  Smith  (1967,  1976),  obviating  a detailed  discussion  at  this  point. 
Theorem  2.2  differs  from  Theorem  2 of  Smith  (1967)  only  in  that  we  have 
replaced  M*  by  the  broader  class  M.  The  (non-trivial)  changes  in  the 
proof  required  by  this  generalization  are  given  for  the  Fourier  series 
situation  by  Smith  (1976) , and  since  the  task  of  carrying  out  these 
modifications  for  the  Fourier-Stielt jes  case  is  lengthy  albeit  straight- 
forward, we  refer  the  reader  to  the  Appendix  for  a comiilete  proof  of  our 
version  of  the  Wiener-Pitt-l.evy-Smith  result. 

One  important  modification  does,  however,  merit  special  ccmment. 

Both  proofs  given  by  Smi'.h  (1967,  1976)  involve  the  construction  of 
a emooth  mutilator  function,  abbreviated  SMF.  Given  four  real  const.uits 
a < 0 < Y < <5  the  S.MF  q^(x;  u,6,y,6)  based  on  these  points  has  the 
following  properties:  It  vanishes  when  x s a or  when  x ^ 6 and  has 
the  value  unity  on  the  interval  Bsxsy  It  is  irionotonically 

increasing  cxi  a < x < 0 and  monotaiically  decreasing  on  y < x < &. 

The  SMF  is  infinitely  differentiable,  and  eacJi  derivative  is  bounded, 

vanishing  identically,  except  when  a<x<0  or  y < x < 6.  Write 

q(x:,  0,0, Yf6)  * ^ 1 q^(e;  a,B,Y,6)d0. 

The  SMF  constructed  by  Smith  (1967)  has  the  property  that  q(x;  a,0,Y,'5) 
e L(M;  v)  for  any  M(x)  and  any  v 2 0.  However  when  M*  is  replaced 

by  M a much  smoother  SMF  is  required;  for  a construction  see  pages  47- 
48  of  the  paper  by  Smith  (1976).  We  shall  refer  to  this  particular  SMF 
in  subsequent  applications  of  Theorem  2.2. 

It  is  interesting  to  note  that  the  amount  of  smoothness  that  can  be 
built  into  a SMF  is  restricted  by  the  fact  that  it  has  a compact  suppwart. 
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Smith  (1971)  provea  that  a necessary  and  sufficient  condition  for  the 
existence  of  a probability  density  function  p(x)  with  compact  support 
such  that  p^(0)  e L^(M;  1)  is  that  M(x)  satisfy  the  Umbrella  Condition; 
this  is  a consequence  of  Theorem  XII  of  Paley  and  Wiener  (1934).  Since 
the  construction  of  sucii  a density  is  the  essential  step  in  the  derivation 
of  a SMF,  we  cannot  hope  to  improve  Theorem  2.2  to  include  functions 
M(x)  which  grow  faster  than  tJie  rate  permitted  by  the  Umbrella  Condition. 
Of  course  when  F(x)  c P(M,  v)  and  M(x)  grows  like  e^,  it  is  still 
possible  to  deal  with  renewal  theoretic  questions  (and  this  has  been 
done  by  various  authors) , but  this  situation  requires  the  use  of  ad  hoc 
techniques. 


2.2  Smoothing  llaqic 

We  new  use  the  Wiener-Pitt-Levy-Smith  approach  to  prove  a result 
(Theorem  2.4)  which  describes  the  asymptotic  behavior  of  the  renewal 
function  when  F(x)  has  a finite  variance.  Although  Theorem  2.4  is 
foreshadowed  in  the  addendum  to  the  paper  by  Smith  (1967) , several  novel 
features  will  emerge  from  our  proof,  as  well  as  a slight  generalization 
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of  the  preliminar>’  version. 

Assume  that  F(x)  t.  (?(M;  2)  C for  some  M(x)  . M.  Since  the  renewal 

n 

fui\ction  HCx)  is  not  a function  of  totally  bounded  variation,  it  does 
not  possess  a Fourier-Stieltjes  transform,  hlicn  dealing  with  positive 
random  variables  corresponding  to  renewal  lifetimes,  this  difficulty 
can  be  avoided  by  using  Laplace-Stieltjes  transforms.  Hewever  we  would 
then  be  forced  to  recast  Theorems  2.1  and  2.2,  thus  losing  the  capability 
for  possible  future  extensions  to  unrestricted  random  variables. 

Instead  we  shall  deal  with  a nodified  renewal  function  W^(x) 
which  is  bounded,  nondecreasing  and  absolutely  continuous.  Let  A,. (x) 

a 

be  the  triangular  density  fiinction 

AjCx)  = * |x|  5 a 

3l 

= 0,  otherwise, 

so  that  A^(e)  * . For  0 < ; < 1 define  (suppressing  the 

^ (ae/2)'^ 

dependence  on  a) 

OD 

(2.2.1)  H (x)  * I A (x-z)dF  (z), 

n-0  J -<»  ® " 

where  Fq(x)  • P{0  s x}  and  Fj^(x)  * P{Xj  ♦...♦  s x},  n = 1,2,...  . 
Then 

H‘ (0)  - 

By  Theorem  2 . 1 

F^(e)  - 1 ^ lij  ie  ♦ ^ (iO)^  ^"(2)^®^' 
so  that  if  we  write  6 ■ (1*C)  * CMj  i0.  then 
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(2.2.2) 


H^(e) 


A,(0) 

ci 


^2  2 ^ 

B ^ ~ F-J^j  (0) 


Therefore 


H^Ce) 


^2  2 4 

el6  + ^ i" 


(2) 


(0) 


Let  I be  a small  open  interval  containing  the  origin.  For  0 c I it 
is  not  difficult  to  show  that 


^2  2 

16  ^ / 0^C 

F(2) I ^ 2 ’ 

and  for  all  0, 

|Bl  > 

0|.  Consequently  for  0 e 1 

1h[(0) 

A3(0) 

(2.2.3) 

- ^ 1 = 0(1). 

unifomly  with 

reapeat  to 

4- 

Write  ff^(0)  for  the  Fourier  transform 

of  the  modified  renewal  function  corresponding  to  the  negative  exponential 
distribution  with  mean  Clearly 

A'(e)(l  - u,i0) 

ff^Q)  = 1 , 

^ 1 - Mjie  - c 


and  for  0 « I,  there  exists  a positive  constant  C such  that 


+ 1 l-Uii© 

|A^^(0)|  || ^ I s C 


Uj  C0 


(2.2.4) 


l-Pj^i0-i; 


6(1-Pji0-;) 


Cmj|0| 

1-p^ie-cl 


Cp^|0| 


Al-O^  * uIq^ 


s C. 
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(2.2.3)  aiid  (2.2.4),  together  with  the  Triangle  Inequality,  iiqily  that, 
for  0(1, 

|Hj(e)  - R^je)|  = 0(1) 

uniformly  for  0 < ^ < 1. 

Since  we  are  assuming  that  F*(0)  belongs  to  C^,  it  follows 

that  sup  |F^(e)|  < 1.  This  im{ilies  that  IH^(O)  - ff  (0)  | is  bounded 
0/1  ^ 

as  C + 1 for  0/1.  Furthennore  (2.2.2),  (along  with  the  fact  that 

r ^ 

A (0)  is  integrable,)  can  be  used  to  show  that  H (G)  is  integrable  for 
3 C 

0/1,  and,  of  course,  the  same  claim  may  then  be  niade  for  W^(0). 

Consequently  we  may  legitimately  apply  the  Fourier  inversion  formula 


(2.2.5) 


e'^®^{Hj(0)  - H^(e)}d0, 


since  the  integral  in  (2.2.5)  is  absolutely  convergent.  Setting 


H(x)  >■  lim  H (x)  and  ff(x)  = lim  ^ (x) , 


it  follows  by  bounaed  convergence  that 


(2.2.6)  H(x)  - H(x)  - ^ 


4(8) 


i-phe) 


♦ 1 


d0. 


Using  the  expansion  F^(0)  * 1 + ijji0  whicli  is  a consetiuence 

of  Theorem  2.1,  we  may  formally  write 


1-F^(0)  -pji6F|jj(0) 


1 ( 1 ] 

-u,ie  4-[i-f|jj(0)iJ 
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(2.2.7) 


-U^i9  k=0 


-M^ie  -gjie 


1 - F^(e) 


Therefore 


1-F^( 


(e) 


say,  where  L^(e)  = 


t, 


[i-F|^)(e)] 

1 - f'^(o) 


-Ujie  2m^ 
2 


Our  objective  is  to  show  that  L^(e)  is  the  Fourier-Stieltjes 
transform  of  a function  of  bounded  variation  in  a particular  B-class,  and 
we  shall  enploy  Theorem  2.2  for  this  purpose.  First  we  prove  the 
following  auxiliary  result: 


LEfUA  2 . 3 (Smoothing  Magic)  Let  F(x)  e P(M;2)  for  eome  M(x)  c M. 


Then 

(2.2.8) 

[1  - 

£ 8^(M;  1). 

-iO 

PROOF. 

We  want  to  show  that 

(2.2.9) 

2(1--  F^jjO)]  1 

- (F^dO)]^ 

-ie 

-ie 
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Write  U(x)  for  tlie  unit  function  P{0  <■  x},  and  define 


F^jj(x)  »=  U(x)  - F^)(x) 


F^)2W*  U(x)  - I F^^  (x-z)dF^^  (z)  . 


Then  proving  (2.2.9)  is  equivalent  to  showing  tliat 


(2.2.10) 


2F?,.(x)  - " ‘■(M;  1) 


(1) 


The  folloiving  respresentation  for  requires  no  proof,  having 

an  obvious  interpretation: 


x/2 
0 


- ^^1 


dz  . 


Consequently  showing  (2.2.10)  amounts  to  proving  that 


2 


- 2 


x/2  ^ 
0 


Izlill 

- ^1  _ 


dz  € L(M;  1) 


Since  ^ t L(M;  1)  and 
Fl 


M(u)du  < xM(x)  , 


we  have 


0 0 


M(u)  dudx  < 

^1 


By  Fubini's  theorem  for  nonnegative  functions  it  follows  that 

M(x)F^j  (x)dx  < ®. 
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On  the  other  tiand,  since 


uM(u) 


1-F(u)~ 
- - 


du  ■»  0 


as  X -►  ®,  we  have  xM(x)F^j(x)  -►  0.  Therefore 


(x) } dx  < ®. 


Consequently  by  a change  of  variable 


r 


x{M(^-)F^j(Jj}^  dx  < "o, 


X-,w/^X, 


and  since  M(x)  s M(2-)M(y)  , it  follows  that 


(2.2.11) 


IF(i)(5)]^  e L(M;  1) 


Since  F(x)  has  a finite  variance, 


r 

1 n 


F(i)(^)du  < CO, 


and  since  uM(u)F^j(u)  -*•0  as  u -»  «>,  we  obtain 


(2.2.12) 


F(i)(2)F^)(x)  € L(M;  1), 


Finally  a second  application  of  Fubini’s  theorem  yields 

fX/2 


*»<'■>{ 


{F^^j(x-z)-F^,,(x)J 


(1)' 


l^~|dz}dx 


r«  rx/2 

s xM(x)  I z 
JO 


0 


l-F(x-z) 

^1 


1-FC^) 

V Wl 


dzdx 


26 


(2.2.13) 


r 

''0 

r 


P X M(xJ  dxdz 

^2z 

/CP 

(y+z)M(y>z)  dydz. 


Over  the  range  of  integration  y ^ z we  have  M(y+z)  < M(y)M(z). 
Consequtaitly  the  integral  in  (2.2.13)  is  less  than  or  equal  to 


zM(z) 


yM(y) 


l-F(y) 


dydz 


which  is  finite,  since  ^ c l.(M:  1).  Consequently 


(2.2.14) 


.x/2 

^ [F^jj(x-z)-F^j(x)l[l^pi]  dz  c L(M;  1) 


(2.2.11),  (2.2.12)  and  (2.2.14)  together  imply  (2.2.10),  proving  the 
lenna. 


We  note  at  this  point  that  the  result  of  Lenma  2.3  is  quite 

4 2 

remarkable.  In  view  of  the  fact  that  [1  - F|jj(G)]  is  in  the  class 
8^(M,  1),  we  might  reasonably  conclude  that  (1  - f|jj (9) ]^/(-ie)  is 
in  the  class  8^(M;  0),  i.e.  we  would  expect  to  loee  one  whole  moment 
as  the  price  to  be  paid  for  dividing  by  -i0.  The  convolutiwi  in  the 
nimerator  of  (2.2.8)  apparently  causes  the  "lost"  moment  to  "reappear", 
and  we  refer  to  this  surprising  efficacy  as  amoothing  magic. 

Now  write  q*^(0)  for  the  special  SMF  q'^(0;  -2,  -1,  1,  2)  and 


define 
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> 

£■ 

v'- 

& 


l}(0)  * q'O)  L^0) 

and  = [1  ■ q^C0)]L^(0). 

Clearly 

l}(0)  * 

Set  J “ 1-2,  2]  and  i^Cz)  * K Since  i*  continuous  at  the 

origin,  |Fqj(0)|  is  bounded  away  from  zero  in  a neighborhood  of  the 
origin  say  (-6,  6).  On  the  other  hand 

inf  |1  - F^(0)|  = A > 0, 

6s0s2 

-2S0S-6 

since  otherwise  F(x)  would  be  a lattice  distributicn.  Consequently 


[l-Fjj)(0)J‘ 


r 

‘(1) 


101 


(0) 


inf  ii-lliSU 
<5s0s2  I'^^l^Ol 
-2S0S-6 


‘^l 


> 0. 


Thus  for  0 € J,  z 
outside  the  circle 


(0) 


maps  out  a continuous  curve  that  lies 


Using  Part  A of  Theorem  2.2  we  conclude  that  q^(0)/F|j^j  (0)  is  in  8^(M;  1) 
It  then  follows  by  the  smoothing  magic  of  Lemna  2.3  that  l|c6)  t 8^(M;  1) . 
It  is  somewhat  easier  to  deal  with 

+ t [1-F+  (0)]2 

l5(0)  - [1  - q70)]  -4^ . 

Here  take  J - (-«»,  2)^(2,  »)  and  4>(z)  * . Since  F^(0)  « C^,  it 

is  not  difficult  to  see  that  p[F^(0)]  < 1.  As  0 runs  through  J, 
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|F^(e)|  is  bounded  away  from  unity.  By  Part  B of  Theorem  2.2 
1 - F^e) 

and  it  follows  that  L^Ce)  c 6^(M;  1).  Consequently 
L^(0)  - L|(e)  ♦ l|(0)  c B^(M;  1). 


We  have  shown  that 


1-F^(0)  -ijji0 


is  the  Fourier-Stieltjes  transform  of  — ^ F^,n(x)  + L(x)  where 


L(x)  e 8(M;  1).  Consequently 


/ 1 . 1 

4-F^(0)  -Viji0 


is  the  Fourier  transform  of 


A^(x-z)  d|  ^ F(2) 


F,,,(z)  ♦ L(2) 


}-C 


A (x-z)dU(z). 

3 


From  (2.2.6)  it  follows  that 


ff(x)  - f 

) .OC 


A„(x-2)dU(z) 


But  ff(x)  ■ I A,(x-z)  — ♦ A,(x),  so  Uiat 
Jq  a Uj  a 


Aj,(x-z)  d 
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).c 


AgCX-Z)^ 


U(Z) 


dz 


+ d 


-"2 

_7T 


F{2)(z) 


L(z) 


- dU{z) 


}• 


A^(x)  may  be  replaced  by  linear  combinations  of  triangular  derisities, 
and  these,  in  turn,  may  be  used  to  approximate  characteristic  functions 
of  intervals  by  a "sandwiching"  process  described  by  Smith  (1964).  By  a 
standard  extension  argument  we  then  obtain 

ll(x)  « ^U(x)  f -i-  ♦ L(x)  - U(x)  ♦ C. 

^1  2u{ 

Since  pj  > 0 it  follows  from  the  Strong  Law  of  Large  Nuirtjers  that 
H(x)  0 as  X - oo.  Therefore  C = -L(-  «)  =0. 


We  now  state  the  renewal  theorem  >diich  has  been  the  aim  of  the 
preceding  discussion: 

THEOREM  2.4  Suppose  that  sequence  of  iid  positive  vandom 

variables  with  distribution  function  F(x)  e P(M;  2)^  C for  some  M(x)  e M. 
Then 

” M 

H(x)  - I P{X.  X s x)  - - l)U{x)  + ^ F,,,(x)  + L(x), 

n-1  " ‘'l 

where  L(x)  is  a function  of  bounded  .variation  in  the  class  8(M;  1), 

L(-  «)  ■ 0,  and,  in  particular  , 

as  X -►  *. 
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Reference  to  renewal  theorems  of  this  type  (involving  a derived 
distribution  term  in  the  expansion)  appears  to  have  been  made  first  by 
Smith  (19b7);  see  the  addendum  to  that  paper,  nie  version  stated  above 
seems  to  be  the  most  general  result  uith  vespeat  to  the  moment  aloes  M 
that  can  be  obtained  via  the  Wiener-Pitt -Levy-Smith  approach.  The  proof 
of  Theorem  2.4  does  suggest  extensions  in  other  directions  which  will 
be  taken  up  in  subsequent  chapters.  In  Chapter  4 we  shall  discover  some 
smoothing  magic  in  an  investigation  of  the  renewal  function,  assuming 
F(x)  c P(M;  l+a),0<a<l.  This  will  involve  adding  more  terms  to 
the  expansion  in  (2.2.7).  In  Chapter  5 we  shall  examine  cumulants  of 
the  renewal  process  (and,  in  particular,  the  variance,)  when  more  than 
a second  moment  is  assumed  for  F(x). 


aiAm;R  iii:  aii  applicatioii  to 

SUPERPOSITION  OF  RENEWAL  PROCESSES 

Having  examined  a fundamental  problem  in  renewal  theory  in  the 
previous  chapter,  we  shall  nw  apply  the  main  result  (Theorem  2.4)  of 
that  discussion  in  a brief  study  of  superposed  renewal  processes.  The 
literature  concerning  superposition  is  quite  extensive,  and  consequently 
we  have  confined  the  review  in  Section  3.1  to  a small  nunfcer  of  references. 
Section  3.2  deals  with  the  probabilistic  behavior  of  superpositioi  under 
transient  conditions,  an  aspect  which  has  largely  been  ignored  by 
previous  authors. 

3.1  A Selective  Review 

Suppose  that  is  independent  sources  each  give  rise  to  a series  of 
events  and  that  the  outputs  of  these  sources  are  superimposed  into  a 
single  pooled  output.  The  superposition  process  is  thus  a series  of 
events  in  wliich  an  event  occurs  at  time  t iff  an  event  occurs  at  t in 
at  least  one  of  the  N component  processes.  This  model  was  first  studied 
by  Cox  and  Smith  (1953)  in  connection  with  a problem  in  neuro-physiology; 
however,  it  has  also  arisen  in  a number  of  other  diverse  areas  of  appli- 
cation, including  the  theory  of  congestion  in  telephone  traffic, 
investigaticwis  of  canputer  failure  patterns,  and  studies  of  multi-stage 
industrial  processes  involving  similar  machines  operating  in  parallel. 

Cox  aiKl  Smith  (1953)  dealt  with  the  superposition  of  strictly  periodic 
sequences  of  events,  i.e.,  when  the  events  from  the  ith  source  occur 
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exactly  at  times  C^,  20^  39^,  where  0^  is  the  period  of  the  ith 

source,  (i  = 1 ,2, . . . .W ,)  and  tlie  periods  are  mutually  irrational. 

Although  this  is  a deterministic  situation,  it  can  be  shown  that 

as>Tnptotically  as  N becomes  large,  the  pooled  outjxit  (viewed  over  a 

long  period  of  time)  becomes  indistinguishable  from  a Poisson  process  with 
N 

parameter  A * I (1/0.).  Mild  assumptions  are  made  to  ensure  that  as  .N 
i*l  ^ 

tends  to  infinity,  the  time  scale  is  dilated  so  that  no  small  group  of 
[ieriods  0^  is  cCMiiparable  with  tiie  mean  interval  between  events  in  the 
superposition. 

A ccxrscquence  of  this  rather  surprising  result  is  that  for  large  N 
the  analysis  of  local  behavior  of  the  superposition  yields  little  infor- 
mation regarding  the  individual  sources.  It  is  well  known  (and  easy  to 
demonstrate)  that  the  superposition  of  p independent  Poisson  processes 
each  of  parameter  A is  itself  a Poisson  process  of  parameter  pA. 
Therefore  no  firm  conclusions  can  be  drawn  from  the  analysis  of  a pooled 
output  which  does  not  differ  significantly  from  a Poisson  process. 

For  small  N it  is  possible,  at  least  in  principle,  to  estimate  the 
0^'s  accurately,  provided  the  pooled  series  available  for  analysis  is 
Icaig.  The  procedure  consists  of  decomposing  the  frequency  distribution  of 
the  intervals  between  successive  events.  For  larger  values  of  N,  Cox 
and  Smith  (1953)  proposed  an  analysis  based  on  the  variance-time  curve 

VviCt)*  Var{nijiiber  of  events  occurring  in  the  superposition  during  [0,t]}. 
*1 

V,g(t),  which  can  be  estimated  fron  observations  on  the  superposition, 
oscillates  about  N/6  for  large  t iff  the  series  is  the  pooled 
outlet  of  w j)eriodic  sources. 

More  generall)  we  wish  to  study  the  behavior  of  the  superposition 
when  the  sources  form  inde{)endent  renewal  processes.  The  superposition 


will  not,  in  i;eneral,  be  a renewal  process,  since  tiie  intervals  between 
events  are  not  necessarily  independent  random  variables.  (In  fact,  if 
the  sujier]X)sition  of  two  independent  renewal  processes  with  the  sjme 
interoccurrence  distribution  F(x)  havinj;  me.'in  p < ■»  is  also  a 
renewal  process,  then  all  three  processes  arc  Poisson;  see,  e.g.,  Karlin 
and  Taylor  (197S,  page  220  ).) 

Cox  and  Smith  (1954)  assumed  that  for  each  source  the  intervals 
between  successive  events  fonn  a sequence  of  iid  i)ositive  random 
varial^les  with  distribution  I'(x) . ('.v'c  shall  refer  to  this  as  the 

identically  distributed  case.)  They  considered  the  equilibrium  behavior 
of  the  supeiposition  a long  time  after  the  start  of  the  process  as  follows 

Por  i = 1,2,...,N  let  be  the  time  measured  back  from  a fixed 

sampling  point  to  tlie  preceding  event  on  the  ith  source.  Define  Y 
as  the  corresponding  random  variable  for  the  superposition.  Then 

Y = min  (Y^,. . . ,Yj^.) . 

For  renewal  processes  in  equilibrium  the  Key  Renewal  Theorem  can  be 
used  to  show  that 


(3.1.1) 


P{Y.  > y) 


i^dx 

y p 


1 - P(i)(y). 


provided  that  p 


r 


xdF(x)  < (Note  that  (3.1.1)  does  not  depend 


on  the  dioice  of  the  samjiling  point.)  Then  by  independence 


p{Y  > y)  - [1  - f^(i)(y)r 


The  density  corresponding  to  the  backward  delay  distribution  for  the 
SLq)er{)osition  is  given  by 
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(5.1.2)  ^ [1  - Hy)\[i  - 


.Mow  let  G(x)  denote  the  (equilibrium)  distribution  of  the  interval 
between  events  in  the  supcrjiosit ion,  and  let  ^(x)  be  the  corresponding 
density.  Clearly  the  nie<'in  interval  between  events  in  the  superposition 
is  y/N.  Suppose  we  take  a sampling  point  chosen  at  random  over  a very- 
long  time  intewal  and  define  Z as  the  time  measured  back  to  the  last 
event  in  tlie  superposition.  If  .X  denotes  the  length  of  the  inter- 
event interv-al  in  which  the  samjiling  point  lies,  then  X has  the  length- 
biased  density  xg(x)/(uA').  The  conditional  density  of  Z given  that 
X “ X is  uniform  ever  (0,  x ).  Tlius  the  unccxiditional  pdf  of  Z is 


(3.1.3) 


r J_  . dx  = . 

-'y  ^o  u/M  ° y/N 


Because  the  renewal  processes  are  in  equilibrium,  tihe  expressions  (3.1.2) 
and  (3.1.3)  are  equivalent,  and  consequently 


(3.1.4)  1 - G(y)  « [1  - F(y)][l  - F(i)(y)r'^'^- 


Write  L for  the  length  of  an  interval  between  consecutive  events  in  the 
pooled  output  under  equilibrium.  (Note  that  dividing  L by  l:(L)  = y/N 
corresponds  to  a dilation  of  the  time  scale.)  Then  assuming  F(0)  = 0 
( 3.1.4)  implies  that  as  N -♦  ®, 


Ksw  ' y}  ■ I'  - 

- |1  - F(^))  ( 1 ■ Juf  * 

^ ^ 'O  y > 
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Cox  and  SmitJi  (1954)  showed  equivalently  that  as  N tends  to  infinity 
the  limit  distribution  of  the  nijnber  of  events  occurring  in  an  interval 
of  length  ut/N  is  Poisson  with  parameter  t.  They  made  the  mild 
assumjition  that  there  exists  6,  0 < B < 1,  such  that  F-(t)  = 0(t®) 
for  small  t.  It  can  be  shown  more  generally  that  in  the  limit  the 
numbers  of  events  in  non-overlapping  interv'als  are  independent,  i.e.,  the 
siq^erposition  is  a Poisson  process.  Such  results  provide  a theoretical 
basis  for  making  a "Poisson  assumj^tion"  in  a number  of  applications,  just 
as  the  Central  Limit  Theorem  is  frequently  invoked  to  justify  assumptions 
of  normality. 

Cox  and  Smith  (1954)  pointed  out  the  difficulty  of  analyzing  a 
superposition  when  N is  large,  noting  that  the  sources  might  equally 
well  be  strictly  periodic  or  renewal  processes.  They  suggested  a variance- 
time curve  analysis  for  situations  in  which  N is  small  and  unknown,  (cf. 
Cox  and  Lewis  (1966,  page  215).)  Let  o,  and  refer  to  F(x). 
Then 


V^(t) 


No^t 


~ N 


1 o"  ^3 
6 ^ TT  ■ 73 


for  very  large  t.  Comparison  with  the  empirical  variance-time  curve 
yields  estimates  for  the  four  unknown  parameters.  However  these  are 
based  on  san^ile  estimates  of  higher  moments  which  tend  to  be  unreliable. 
Cox  and  Lewis  (1966)  additionally  noted  that  Uiis  approach  is  likely  to 
be  inefficient  because  transient  effects  are  not  taken  into  account, 
suggesting  an  area  for  further  investigation.  We  shall  return  to  several 
related  issues  later  in  Sections  5.3,  5.4,  and  6.2. 

Since  1954  very  few  authors  have  dealt  with  the  inferential  aspect 
of  superposition.  On  the  other  hand,  limit  theorems  have  received 


36) 

increasing  attention,  and  most  recently  there  has  been  a surge  of  interest 
in  the  supeqiosition  of  ver>'  general  1)7)05  of  point  processes. 

IGiintclune  (iil60,  Chapter  5)  observed  that  the  process  describing 
the  arrival  of  calls  in  a telephone  exchange  often  approximates  a Poisson 
process  more  closely  than  might  be  expected.  He  explained  this  phenomenon 
by  shfxving  tliat  the  su{)erposition  of  indefinitely  many  uniformly  sparse 
but  not  necessarily  identical  renewal  processes  tends  to  a Poisson  process. 
Since  the  statement  of  this  result  in  the  English  translation  of 
Khintchine's  monograph  is  somewhat  awkward,  we  quote  the  following  recent 
version  due  to  Karlin  and  Taylor  (1975,  Chapter  5): 


For  n = 1,2,...,  and  for  i = 1 , . . . ,k^,  where  “ ^5  n 

let  be  a renewal  counting  process  with  underlying  distribution 

Fni(t).  (For  every  n the  processes  ^ 

n 

assimed  to  be  independent.)  The  superposition  process  is  defined 


as 


= .1^  t ^ 0. 


Then  according  to  Khintchine's  theorem. 


lim  P(N^(t)-j} 

n^ioo 


. (j  * 0,1,...) 


if  and  only  if 

lim  I F . (t)  - Xt, 
n«>  i*! 


provided  that  lim  max  F . (t)  ■ 0. 
n~>  Isisk 

n 


Franken  (19b3)  proved  a refinement  of  this  result  for  the  iid  case. 
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Let 


- -'ni  V 


for  i = and  n = 1,2,...,  where  the  laiderlyinj;  distributioas 

Fn'Ct)  are  for  i = l,...,n  identically  equal  to  • L)efine 

n 

^ ~ ’ 

1 = 1 

and  assume  that  nH^(t)  = il(t)  for  all  n ;ind  t,  where  is  the 

renewal  function  corresponding  to  F^ft) , and  H(t)  is  an  arbitrary 
renewal  function.  Franken  (1963)  showed  that  if  F^^(+0)  < 1/2,  then 


0<k<x 


P{Cn=k} 


’4-(k) 


<.<x 


r 

1 

i=l 


Qi(k) 


+ 0 


-r+1 


where  the  Q^(k)  are  certain  calculable  polynomials  in  k,  r=  0,1,...  . 

If  Pj^(*0)  < 1/5,  then  the  estimates  so  obtained  are  uniform  in  x. 

Franken's  proof  (which  is  quite  con^ilicated)  is  based  on  a generating 
function  approacli  which  makes  use  of  a Chari ier  Type  B series. 

Unfortunately  the  condition  "nli^(t)  = H(t)"  is  unrealistic,  ruling  out 
use  of  the  ex]iansion  in  many  applications.  This  restriction  has  apparently 
been  overlooked  by  authors  quoting  Franken's  result;  see,  for  examiile,  the 
review  by  Cinlar  (1972). 

Ambartzumian  (1905)  discussed  two  "inverse  problems"  related  to  the 
sui)erposition  of  renewal  processes:  (1)  determining  S and  F(x)  when 
the  sources  consist  of  W identical  rencnval  processes,  and  (2)  determining 
F(x)  and  A when  the  conq)onent  processes  consist  of  a Poisson  process 
with  parameter  A and  a renewal  process  with  underlying  distribution  F(x). 
Ambartzumian' s results  are  stated  vaguely,  and  no  numerical  examjiles  are 
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presented,  liis  "general  method"  for  the  first  problem  does  not  go  beyond 
the  work  of  Cox  and  Smith  (19S4),  nor  is  it  clear  that  his  "method  of 
moments"  aitswcrs  the  second  question  satisfactorily  in  a statistical  sense. 

In  a second  paper  /Xmbartzunian  (1909)  discussed  the  correlation 
properties  of  the  intervals  in  the  supcri)osition  of  N not  necessarily 
identical  renewal  processes  in  exjui librium.  Let  X^,  Xj^,  X^.---  denote 
the  lengths  of  consecutive  intervals  between  events  in  the  superposition, 
and  let 

00 

^(z)  = I ' 

n=l  " 


where  = CorrCX^.Xj^) . Also  let  F^(x)  denote  the  underlying  distri- 
bution for  the  ith  renewal  process.  .>\ssume  that  (A)  for  i = 2,3,..., 
N the  Laplace  transforms 

^i(s)  = P dF.(x) 


converge  in  the  strip  -a  < Res  < 0 for  some  a > 0,  and  (B)  each 
F^(x)  possesses  an  absolutely  continuous  component.  Then  (in  the  some- 
wliat  confusing  notation  of  Ambartzumian) 


c N ui-o. 

(c  -1)4,(1)  - I 
^ ° K«1  2 

r 2 -1  r 

X dFj^  (x)  , and  = 

) o ' o 

Ambartzumian  did  not,  however,  extract  closed  expressions  for  the  serial 

correlations. 


where  c. 


xdFj^(x) 


Blunx^ntlial , Greenwood,  and  Herbach  (1968)  considered  the  rate  of 
convergence  to  the  exponential  form  of  the  inter-event  distribution  for 
the  superposition,  both  as  a function  of  time  and  as  a function  of  N, 
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the  number  of  comjionent  processes.  They  examined  both  the  iid  and 
the  non- identical  cases,  assuming  that  the  underlying  distributions  are 
members  of  the  ganria  family  with  selected  shape  parameters.  By  making 
such  concrete  assumptions,  Blumenthal,  Greenwood,  and  Herbach  were  able 
to  generate  a number  of  interesting  plots  which  enabled  them  to  rate  the 
effects  of  factors  such  as  system  age,  system  size  and  shape  of  the 
distribution  on  deviation  from  the  exponential  limit.  The  most  important 
conclusicHi  was  that  system  age  can  cause  very  large  deviations  from  the 
limit, and  that  these  can  extend  over  a relatively  long  time  span.  The 
work  of  Blumenthal,  Greenwood,  and  Herbach  is  apparently  the  first  to 
deal  with  the  transient  aspects  of  superposition  from  a practical  stand- 
point. 

Lawrance  (1973)  studied  the  dependence  of  intervals  between  events 
in  the  superposition  of  independent  (not  necessarily  identical)  stationary 
IKJint  processes.  In  particular  he  obtained  the  joint  distribution  of  any 
number  of  adjacent  inter-event  intervals  following  an  arbitrary  event  in 
the  superposition.  Although  this  distribution  can  be  stated  in  a closed 
form,  the  result  is  notationally  intractable.  In  fact  Lawrance  found  it 
necessary  to  restrict  his  study  to  the  joint  distributions  and  serial 
correlations  of  at  most  three  adjacent  intervals.  His  work  includes  some 
interesting  numerical  results  based  on  superpositions  of  Hrlang  renewal 
processes. 

Recently  Coleman  (1976)  dealt  with  a special  type  of  suiierposition 
involving  dependence.  Siqjpose  we  start  with  a renewal  process  in  equili- 
briun  and  choose  independently  a sampling  point.  The  distances  from  this 
point  measured  forward  and  backward  to  renewal  points  define  two  new 
renewal  processes.  Their  superi)Osition  constitutes  a folding  over  of  the 
past  of  the  original  process  onto  its  future,  and  these  are  independent 
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♦ 


only  in  the  Poisson  case.  Coleman  obtained  the  joint  distribution  of  k 
adjacent  intervals  for  this  rather  unusual  examiile  of  superposition. 


3.2  The  Transient  Behavior  of  Superpositi on:  A Renewal  Theoretic  Approach 

The  studies  reviewed  above  have,  for  the  most  part,  dealt  with 
probabilistic  aspects  of  supeq)osition  of  renewal  processes.  We 
believe  that  one  goal  of  such  work  should  be  to  provide  insights  which 
lead  to  improved  statistical  methodology,  and  there  is  clearly  a lack  of 
results  which  are  useful  in  this  sense.  Inference  aliout  the  source 
processes  based  on  observation  of  the  pooled  output  is  feasible  only  when 
the  supeqiosition  differs  significantly  from  a Poisson  process.  This 
suggests  the  need  for  further  investigation  of  supeq)Osition  of  a relatively 
small  number  of  processes  under  time  dependent  (rather  than  equilibrium) 
conditions. 

Although  we  shall  not  attempt  to  develop  statistical  techniques  for 
dealing  with  data  arising  from  superposition.  Theorem  2.4  can  be  used  to 
derive  certain  results  for  the  transient  case  which  may  well  lead  to  more 
precise  statistical  work  in  the  future.  Specifically  we  shall  consider 
the  relatively  simple  problem  of  finding  the  probability  that  k events 
occur  in  an  aribitrary  interval  of  time  for  a suj>erposition  of  N 
independent,  identical  renewal  processes  (Apparently  this 

issue  has  been  overlooked  by  previous  authors,  including  Blunentlial , 
Greenwood,  and  Harbach  (1968).) 

Let  F(x)  » P{Xj^  s x) , and  write  H(x)  for  the  corresponding 
renewal  function.  We  shall  assume  that 
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(1)  N,  the  number  of  sources,  is  fixed  and  relatively  small,  (so 
that  it  cannot  be  regarded  as  tending  to  infinity) , 

(2)  the  first  renewal  lifetime  Xj  for  each  component  process 
begins  at  time  t = 0, 

and  (3)  by  time  f ~ tlie  corajxjnent  renewal  processes  have  not  yet 
reached  equilibrium. 

Furthermore  we  shall  assume  that  F(x)  c P(M;  2)^^  C for  some  moment 
function  M(x)  € M,  using  and  U2  to  denote  the  first  two  moments 

of  F(x). 

Let  At  > 0 be  a fixed  increment  of  time,  and  for  j = 0,1,2,..., 
and  k = 0,1,2,...,  define 


Pj  = P{exactly  j renewals  occur  in  (t^,  t^'^At] 
for  given  conponent  process} 

and  Pj^  * Plexactly  k renewals  occur  in  (t^,  t^'*'At] 

for  the  siqaerposition} . 


Studies  of  tiie  limiting  behavior  of  superposition  as  N becomes 

large  typically  involve  a standardization  which  can  be  thought  of  as  a 

dilation  of  the  time  scale  for  the  sources.  Specifically  the  process 

{X  }*  , is  replaced  by  (HX  /u, }*  We  shall  follow  this  procedure  here 
nn*l  ^ 'nln*! 

for  the  sake  of  comparison  with  the  limiting  Poisson  distributiai  which 

^ 00 

we  shall  write  as  0* 


The  probability  that  no  event  occurs  in  (t^,  t^+At]  for  the  process 
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Note  that  the  first  term  on  tlie  right-hand  side  of  (3.2.1)  is  the 

probability  tJiat  the  first  renewal  takes  place  after  time  t^  ♦ At;  the 

second  term  is  the  probability  that  a renewal  occurs  in  (0,  t^]  such 

that  the  next  renewal  takes  place  after  time  t ♦ At. 

o 

lor  convenience  write 


t^  * ^ * Pj(At)/N 


Using  the  independence  of  the  sources 
P 


0 ■ {i  ■ • « • "(t;)  ■ 


t'+6 

o 


F(t^  + 6 - u)dlUu) 


(3.2.2) 


t' 

o 


F(t^  + 6 - u)dU(u)|. 


(3.2.2)  can  be  simplified  by  applying  the  integral  equation  of  renewal 
theory;  consequently 


(3.2.3)  P„  - - 

ft’+6 

° [1  - F(t’  ♦ 6 - u]dU(u) 

t'  ^ 

o 

(3.2.3)  is  a particularly  revealing  expression  which  does  not  appear  to 
liave  been  studied  elsewhere.  It  involves  both  the  behavior  of  F(x) 
near  the  origin  and  the  behavior  of  li(x)  for  moderately  large  values  of 

X. 

We  shall  deal  with  the  former  by  assuming  that  there  exist  positive 
constants  X and  p such  that 

F(x)  “ Xx^  ♦ 0(x*^^^)  as  X -►  0. 


(3.2.4) 
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This  is  a fairly  mild  condition,  in  view  of  the  fact  that  (3.2.4)  is 
satisfied  by  a number  of  useful  lifetime  distributions,  including  the 
uni  form, negative  exponential,  gamna,  and  Wcibull  families. 

To  handle  the  transient  behavior  of  H(x)  we  apply  Theorem  2.4  of 
the  previous  cliapter.  Substitution  into  (3.2.3)  yields 


(3.2.5)  P = (l 
o ( 


t’*6  . Uj 

° [1  - F(t'>6-u)j[^  * dl-r.Uu)  * dL(u)] 

t;  ° ^1  2p; 


where  the  remainder  function  L(x)  belongs  to  6(Mi  1).  Note  that  the 
bounded  variation  property  of  L(x)  is  essential  to  this  application. 
Now  by  assumption  (3.2.4), 


1_ 

^1 


° [1  - F(t’^6-u)]du  = f- 

t'  ° ^1 

o 


Since  the  second  derived  density  is  given  by 


(v-u)dF(v) , 


it  follows  that 


(3.2.6) 


U'J  ft'  + d 

-L  ° [1  - F(t’><5-u)JdF,2^(u)  = 

2„2  )t; 


F(t^+6-u) ) (v-u)dF(v)du. 


After  interchanging  the  order  of  integration,  sin?)lifying  and  collecting 
terms,  (3.2.6)  reduces  to 
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7^ 

2vi, 


° 2 f, 

u uF(u+t')  ♦ — j 

o M, 


r 


udF(u+t^) 


f-r  [1  - F(t'.6)i  ■ f 


p-^1 


2u 


1 


UlCp+l) 


udF'Cu+t')  + 0(6^*^) 


The  most  intractable  term  in  (3.2.5)  is 


(5.2.7) 


/t'>6 

' o 


t’ 

o 


- A 


[1  - F(t^>6-u)JdL(u)  = L{t^>6)  - L(tp 


6 f (6  1 

(6-v)^dL(v+t^)  + 0 dL(v+t’) 

o ^ ° 


The  difference  L(t^+6)  - bCt^)  is  not  amenable  to  a Taylor  expansion 
unless  F(x)  possesses  additional  smoothness.  We  prefer  instead  to 
assume  that 


(3.2.8) 


0(6 

M(t;) 


whicli  should  not  be  unnecessarily  restrictive,  especially  in  applications 
where  F(x)  may  well  have  more  than  a secontl  moment. 

We  shall  use  (3.2.8)  in  connection  with  the  following  lemma  which 
implies  that 


L(t^^6)  - L(t^) 


7T 


M(t;) 


provided  that  M(x)  is,  additionally,  a special  ty]Te  of  function  of 
moderate  growth. 
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L£f?1A  3.1 

(3.2.9) 

for  every 

(3.2.10) 


Let  M(x)  £ M and  suppose  that 


. 1 . 0(i) 

M(x) 


as  X * 


eons  tan t c > 0.  Then 


L(x+6)  - L(x)  £ 0(M;  2) 


CO 


fRO^.  By  a change  of  variable, 


(3.2.11) 


x^I(x)d{L(x+6)-L(x)}  = r {u^M(u-6)-u^(u)}dL(u) 
- 26  uM(u-6)dL(u)  + 6^  |°°  M(u-6)dL(u)  . 


Using  the  facts  that  L(x)  £ 6(M;  1)  (by  Theorem  2.4),  M(x)  is  a 
function  of  moderate  growth,  and 

M(u-6)  - u^(u)  « uM(u)|u  - i|\  , 

^ M(u) 

we  can  apply  dominated  convergence  to  conclude  that  the  integrals  on  the 
right-hand  side  of  (3.2.11)  are  finite.  Thus  L(x+6)  - L(x)  £ 8(M;  2) 
and,  in  particular,  as  x 

|x^(x)[L(x*6)-L(x)]l  s f u^M(u)|dlL(u+6)-L(u)]I  ^ 0. 
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N.B.  Various  authors  have  obtained  cstinuites  for  the  function 
H(.x+1)  - H(x) , whicli  is  scsiietiincs  referred  to  as  tlie  "Blackwell  difference"; 
see,  for  exjunple,  Tlieorem  3 of  Stone  (1965).  Wc  can  modify  Theorem  2.4 
in  an  obvious  manner  to  obtain  .m  expansion  for  the  Blackwell  difference, 
and  the  remainder  term  L(x+1)  - L(x)  then  belongs  to  B(M;  2)  according 
to  Lemma  3.1,  provided,  of  course,  that  F(x)  c P(M,  2)  and  M(x) 
satisfies  (3.2.9).  Lemma  3.1  thus  improves  the  result  of  Stone  (1965) 
who  showed  that 


if  F(x)  f 1?(I;  2).  We  suspect,  moreover,  that  (3. 2. 10) is  true  for  all 
M(x)  £ M. 
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— /OO  — 2 

+ (At)^  . ~ 1 * — udr(un’)  + 0(At)^'^^  . 

_ uj  o_ 

The  approximation  (3.2.12)  may  be  too  complicated  for  practical  puqxjses; 
however  (3.2.12)  does,  in  fact,  simplify  to 

P = 1 - (At)  1 + — f udF(u+t')  + cf(At)^"'^l 
o _ Ji  o_  I I ' 

so  ti.at  by  com})arison  with  the  limitinj^  Poisson  case, 

it  ( 

(3.2.13)  P = P - — udF(u+t')  0 (At)^^P  . 

o ^^1^6  o I 

Expression  (3.2.13)  is  particularly  interesting,  since  it  reveals  that  .M 
and  t^  (rather  than  the  behavior  of  F(x)  at  the  origin)  determine  the 
rate  of  convergence  to  the  Poisson  limit.  Furthermore,  the  "correction 
term"  in  (3.2.13)  is  specifically  related  to  the  first  moment  of  the 
distribution  F(x) . 

The  approacli  outlined  in  this  section  can  be  used  to  derive 
approximations  such  as  (3.2.12)  for  P^ , P^,  P^,  and  so  forth.  The 
algebraic  details  becone  increasingly  ccmplicated,  and  for  convenience 
we  simply  note  that 

Pi  * * — I udF(u+t')  V of(At)^*P 

^ Pi  is  o 

and  for  k a 2, 

Pj^  •=  o((At)^^P  . 

These  estimates  demonstrate  that  the  "smoothing  magic"  of  Section  2.2  can 
lead  to  detailed  results  concerning  superposition.  IVe  shall  resume  our 
discussion  of  this  application  in  Section  5.3. 


QiAPTP.R  IV;  A REPRESENTATION  FOR  THE 
RENEWAL  FUNCTION  WHEN  THE  VARIANCE  IS  INFINITE 


In  this  chapter  we  resume  our  study  of  the  asymjjtotic  behavior  of. 
the  renewal  function  H(x) . We  shall  develop  an  expansion  for  H(x) 
assuming  that  F(x) , the  underlying  distribution,  has  an  infinite 
variance  and,  furthermore,  that  F(x)  e E>(M;  C,  where  M(x)  e M* 

and  0 < 6 < 1.  Some  previous  work  related  to  this  problem  is  reviewed 
in  Section  4.1.  The  methods  used  to  prove  Theorem  2.4  are  relevant  to 
the  present  situation,  altliough,  as  we  show  in  Section  4.2,  a different 
kind  of  "smoothing  magic"  is  necessary.  Our  main  result  (Theorem  4.6) 
is  contained  in  Section  4.3. 

4.1  A Theorem  of  Stone  and  Wainger 

In  a study  of  tlie  theory  of  recurrent  events  Stone  and  Wainger  (1967) 

dealt  with  a lattice  distribution  (f  }°°  defined  on  the  integers 

n n= 

oo 

and  with  the  corresponding  renewal  measure  .oo‘  more 

familiar  situation  wliere  f^  * 0 for  n < 0,  f^  is  interpreted  as  the 
probability  that  an  periodic  event  takes  place  for  the  first  time  at 
time  j,  and  Uj^  is  interpreted  as  the  probability  that  a recurrent 
event  occurs  at  time  k.)  Note  that  -a. 

the  analogues  of  the  probability  density  and  renewal  intensity  functions 
which  arise  when  F(x)  is  assumed  to  be  absolutely  continuous.  Specifi- 
cally Stone  and  Wainger  considered  the  problem  of  estimating  u^, 
assuming  that  has  at  least  a finite  nonzero  first  moment  pj. 


A brief  description  of  their  work  is  appropriate  here,  since  the  theories 
of  recurrent  events  and  renewals  are  parallel  to  a great  extent. 

Stone  and  Wainger  introduced  a chiss  of  moment  finictions  MCxJ 
defined  by  the  following  properties: 

(i)  2 s M(x)  < 00  for  0 < x < «>, 

(ii)  M(x)  is  nondecreasing, 

Ciii)  y ^ log  M(y)  s x ^ log  M(x)  for  0 < x < y < oo, 

(iv)  X ^ log  M(x)  +0  as  X > °o. 

We  shall  refer  to  this  class  as  M'.  For  part  of  their  work  Stone  and 
Wainger  required  additional  restrictions,  including  the  condition  M(2x)  = 
dCM(x))  for  all  x 2 0.  M'  is  homologous  to  the  classes  M and  M* 
used  in  Chapter  2,  although  the  latter  seem  to  be  more  natural;  conditions 

(iii)  and  (iv)  are  not  obvious  and  were  needed  by  Stone  and  Wainger  for 
purely  technical  reasons.  M'  does  include  functions  such  as 

x^^Clog  x)®  e^  , 


where  0 < 6 < 1,  and  either  y > d or  y = 0 a > 0. 

Two  additional  sequences  are  defined  as  follows:  Let 


Also  set 


■ -J.  ‘J  ‘ 
• ■ j-L 


for  k > 0. 


for  k 2 0. 


Since  is  finite,  the  sequence  **  sunmable.  .Note  that  if 

we  assume,  in  addition,  the  existence  of  the  second  moment  of  {f  }“  , 

* » n n* 
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then  when  n < 0,  the  sequences  ^^k^k-1 

corresjwnd  to  the  first  and  second  derived  distributions,  respectively. 

Write  for  tlie  m-fold  convolution  of  with  itself. 

00 

For  the  one-sided  case  wliere  {f}.  is  concentrated  on  the  non- 

J 1“  ■” 

negative  integers,  Stone  and  Wainger  obtained  the  following  result: 


HlbORFiM  4. 1 (Stone  aj^d  Wainger,  19b7)  Aesime  that 

I M(j)  f.  < » 
j-0  J 

for  some  6,  0 < 6 < 1,  and  some  M(x)  e M'.  Then  for  n sufficiently 

large,  as  k 


(4.1.1) 


'k  u 


1 ni*l 


m+1 


0(p(k)), 


where  for  k > 0, 


p(k)  = 


1 , _Jl_  f 

?^*M(k)  kM(k)  j=k/2  l^lk-jl^""^ 


In  fact. 


(4.1.2)  p(k)  - o 


M(k) 


as  k 


Based  on  such  minimal  conditions  the  estimate  (4.1.2)  for  the 
remainder  term  in  the  expansion  is  suri)risingly  sharp.  Unfortunately  the 
meaning  of  Theorem  4.1  is  not  aitirely  clear;  the  statement  begs  the 
question  of  the  precise  number  n of  terms  to  be  includtxi  in  the  expansion 


for  a particular  choice  of  6,  and  this  issue  is  not  resolved  in  the 
rather  sketchy  proof  given  by  Stone  and  Wainger. 

Results  similar  to  Theorem  4,1  were  later  obtained  by  tssen  (1973), 
(although  he,  too,  failed  to  specify  n) . Whereas  Stone  and  Wainger  used 
ad  hoc  techiiiques  to  obtain  (4.1.1),  Essen  showed  that  a relatively  simple 
proof  is  possible  if  certain  conmutative  Banach  algebras  are  first  intro- 
duced. In  particular,  Essen  derived  approximations  to  Uj^  in  which 
ti»e  remainder  term  is  shown  to  be  of  "o"  or  ”0"  type,  depending  on 
corresponding  assumptions  made  conceniing  the  distribution  <»• 

ITie  Banach  algebra  method  also  yields  results  in  renewal  theor>',  but  in 
this  context  It  ajipears  that  no  significant  advantage  is  to  be  gained 
over  the  approach  discussed  in  Chapter  2;  (cf.  the  remark  by  Smith  (197b; 
page  16)). 

Theorem  4.1  does  suggest  an  expansion  representation  for  the  renewal 
function  H(x) , althougli  we  do  not  believe  (as  conjectured  by  Stone  and 
Wainger)  that  the  tedmiques  used  to  obtain  (4.1.1)  can  be  readily  ada{)ted 
to  the  non-lattice  case.  Of  course  we  have  already  established  such  a 
result  for  H(x)  when  F(x)  has  a finite  second  moment  (see  Theorem 
2.4),  and  clearly  the  exjiansion  in  that  case  consists  of  a single  term. 
Therefore  we  now  consider  the  consequence  of  assuming  that  I'(x)  ■ 


l?(M;  1*6)^  C for  0 < 6 < 1 and  sone  appropriate  moment  function  M(x) , 
and  aasuming,  further  mure,  that  F(x)  has  an  infinite  second  moment. 

This  problem  was,  in  fact,  the  subject  of  a Fh.D.  dissertation  written 
by  Uubraan  (1970)  under  the  direction  of  Stone  at  the  University  of 
California  at  Los  Angeles.  Uubman  made  rather  specialized  assumptions 
concerning  F(x) , such  as 


52 


k 


I 


1 - F(x)  ~ Cx  as  X » “>, 
where  C is  a constant  anU  1 < a < 2,  and, 

FCx*l)  - F(x)  » OCx'^'^)  as  x - <». 

Usin^;  Fourier  analytic  methods  lie  obtained  results  of  the  form 

n ^ 

‘‘(x)  “ I “HT  ^ X - 

nrl  Uj 

wiiere  for  x 2 0,  Tj(x)  » x and 

V»)  ■ “iViW  ■ \ w* 

The  nimiber  n of  terms  is  specified  to  be  such  that  n 2 2 and 
(n+l)/n  < a s n(n-l).  ixibman  did  not  allcw  for  more  general  moment 
conditicns.  It  is  interesting  to  note  tliat  his  techniques  resemble 
methods  used  by  Stone  (1965)  rather  than  the  approach  followed  later  by 
Stone  ajid  Wainger  (1967) . 


4.2  A Preliminary  Look  at  the  ilon-Lattice  Case 


Let  n 2 1 be  some  positive  integer  and  consider  the  following 
formal  expansion: 


1 


1 


l-F+(0) 


ie 


1 


i-li-Ft,,(e)] 


CD 


-PiiQ 


n 4 . [1-f}  (0)]"  ^ 

1 + I tl-Fj,.,(0)lJ  > 

j-l  l-ll-F|i)(0)l 
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(4.2.1) 


1 • V — . Lice). 


I 


-u,i0  j-1  -VJ,i0 


say,  where 


(4.2.2) 


i |i-FL.(e)|"’‘ 

L’(e)  - 

" 1 - F^(0) 


This  expansion  is  simply  an  extension  of  (2.2.7).  In  Section  2.2  we 
showed  that  L^Ce)  t 6^(M;  1);  here  we  do  not  hq)e  for  such  a big 
dividend.  It  seems  reasonable  (in  view  of  Theorem  4.1)  to  expect  that 
L^(0)  i 8^(M;  6)  for  some  n ^ 2 depending  on  6.  Also  note  that 
since  F(x)  has  an  infinite  second  nxjment,  we  can  no  longer  write 
ll-F{jj(0)]/(-Pji0)  as  u2F(2)(®)/2m^- 

Before  proceeding  to  study  the  integrability  properties  of  hj^(x), 
we  derive  an  interesting  alternate  expression  for  hj^(9) • Recall  that 
part  (a)  of  Theorem  2.1  deals  with  Taylor  expansions  of  characteristic 
fuiKtions  when  moments  of  non- integral  order  are  known  to  exist.  Using 
this  result  (and  setting  N * n+1  for  simplicity)  we  obtain 


Ii-fJi)(0)] 


imN  - (sgn  0) 


- Nic 

-2 


Choose  n so  that  N is  even  and  6N  ■ 1.  (This  can  be  accomplished 
without  loss  of  generality;  if  6 ■ e for  some  small  e > 0,  then 
replace  the  moment  function  M(x)  by  M' (x)  ■=  x^M(x).)  Since  c can 
be  any  real  constant,  take  c * (N-l)-tT/2N.  Then  e ' “ 1 and 


[1-f{i)(9)]^ 

-i0 


(s^0)]^ 
— N 
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so  that 


(4.2.3) 


lJ(0) 


(4.2.3)  provides  a particularly  transparent  representation  for  L^(6) » 

in  addition  to  relating  n and  6 in  a surjirising  simple  manner. 

Hcwever  since  it  is  easier  to  deal  with  F^^(x)  than  s(x)  we  shall 

take  (4.2.2)  rather  than  (4.2.3)  as  our  starting  iK)int. 

Because  we  are  new  assuming  that  F(x)  hcis  an  infinite  variance, 

the  manent  function  M(x)  must  necessarily  grew  slowly,  for  examjjle,  like 

1-6 
~r  , 

X log  X . 

Generally  speaking,  x^  ^/M(x)  cannot  be  bounded;  otherwise 


r 2 

x^dF(x)  ■ 

r M(x) 

0 

■'  0 

_M(x)_ 

dF(x)  < ®. 


For  convenience  we  shall  assione  (throughout  this  section  only)  that 
x^  '^/M(x)  is,  in  addition,  a nondecreasing  function. 

Previous  studies  of  the  infinite  variance  case  have  yielded  "o"  or 
"0"  type  estimates  of  the  remainder  function  • Here  our  goal  is 

somewhat  more  ambitious;  we  want  to  show  that  belongs  to  some 

appropriate  moment  class,  and  for  this  purpose  we  shall  utilize  the 
approach  presented  in  Chapter  2.  In  other  words,  we  shall  attempt  to 
develop  some  additional  "smoothing  magic"  in  order  to  cope  with 
transforms  such  as  (4.2.2) 

Consider  once  more  the  remainder  Lj(x),  assuming  now  that 
F(x)  e V(M;  1+6).  Since  M(x)  is  nondecreasing, 
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A 

f U 


6-1 


MCu)du  i 


X iM(x) 


and  therefore 


rx 


^ M(u)dud^^j  (x)  < «>. 


By  Pub ini's  theoren  it  follows  that 


(4.2.4) 


x*^'^  M(x)  [1-F^^  (x)]dx  < “> 


(4.2.4)  is  equivalent  to  writing 
..6n 


I 

n*=l 


,6(n-l) 


x*^’^  f4(x)Il-F^j  (x)]clx  < 


and  using  the  monotonicity  of  M(x)  and  F^)(x)  we  can  deduce  the 
absolute  convergence  of  the  series 


I 2^^  M(2^^"'^^)F^.,(2‘^"). 
n-l 


Consequently 


anJ  this,  in  turn,  implies  that 

00  fL 


I 

n»l 


,6n 


x^*'^  I M(x)  F'j^)(x)| 


dx  < ®. 


I*  x^^'^  { M(x)  F^^j(x)J^  dx 


Therefore 
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and  since  M(x)  = 0(M(j)),  we  can  conclude  that 

-.2 


(4.2.5) 


F^l)(j)  € L(M;  26-1) 


and 


(4.2.6) 


F(l)(j)  F^jj(x)  € L(M;  26-1) 


1 ” 6 

Furthennore,  since  x /M(x)  is  nondec reas inn , 


x^^'^  iM(x)]^  I |'‘^^F^^J(x-2)  - F^j^(x)]  f^^j(z)dz|dx 


X ° [M(x)]  j zf^j(x-z)f^j(z)dzux 


26-1  ...,..,2  z^’"^ 


^ lM(x))‘ 


o M(z) 


f^j^(x-z)z  M(z)fM^  (z)dzdx 


(1) 


s (constant)  |”  M(j)  f(jj(J) 


z M(z)  f (z)dzdx  < ® 


Therefore 


x/2 


(4.2.7) 


{f=j,(x-z)  ■ F^„(x) 


f^j^(z)dz  t L(M;  26-1) 


(4.2.5),  (4.2.6),  and  (4.2.7)  together  imply  that 


2F^)(x)  - F^^2W  « i.(M;  26-1) 


(cf.  the  uerivation  of  (2.2.10)  in  Section  2.)  Using  Theorem  2.2  we  can 
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then  conclule  tliat  l|(0)  t 6^(M,  26-1).  However  this  result  is  not  as 
strong  as  might  be  exiHJCtcii,  clearly  26  - 1 < 6 for  0 < 6 < 1 and 
furtiiermore , 26-1  is  negative  unless  0 < 6 < y . 

Theorem  4.1  seems  to  suggest  that  if  more  terms  are  added  to  the 
expansion  for  1/[1-F^(9)]  the  remainder  Lj^(O)  will  be  a member  of 
6^(M;  6)  provided  n (depending  on  6)  is  large  enough.  Unfortunately 
tlie  methods  we  have  used  to  analyze  Lj(0)  do  not  appear  to  be  adequate 
for  dealing  with  transforms  of  the  type 


(4.2.3) 


[1  - f{jj(0)]"^^ 

- i0 


when  n 2 2.  One  apparent  drawback  is  that  F(x)  must  possess  a 
derivative  of  order  (n-1).  Although  it  may  be  possible  to  overcome  such 
obstacles  by  more  refined  analysis,  we  shall  follow  a different  approach 
in  the  next  section. 


4.3  Two  Auxiliary  Functions;  fj^(x)  and 


Let  us  return  to  (4.2.2)  and  rewrite 


L*(e) 


as 


(4.3.1) 


d(e) 


wj  F|i)Ce)  ^ (-ie)^''"  ^ 


Clearly  neither  (-i9)  nor  f^^ (0)/(-i0)^^”  is  the  Fourier 
transform  of  an  integrable  function.  However  we  aan  express  their  dif- 
ference as  tiie  transform  of  the  difference  of  two  appropriately  chosen 
integrable  functiems.  This  device  will,  in  fact,  enable  us  to  avoid  the 
difficulties  mentioned  above  and  obtain  the  desired  analogue  of  Theorem  4.1. 
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First  we  need  to  introduce  two  auxiliary  functions.  F'or  x > 0 


define 


^l(x) 


^ o Hx-y)^  ^ x^  y J 


wliere  y “ l/x  and  k ^ 2 is  the  smallest  integer  such  that 


= 0(x'^  M(x))  as  X - 

(Since  we  are  dealing  with  positive  random  variables,  we  may  take  fj^(x)  = 
f^fx)  * 0 for  X < 0;  otlierwise  this  definition  must  be  extended.) 

These  functions  faintly  resemble  the  g- functions  whicli  appear  in  the 
proof  of  Lemma  2 of  Smith  (1907;  page  275). 

Notice  that 


(4.3.2) 


fl(x)  - ^2^  = 


X 


and  this  difference  is  integrable,  since  both  f2^(x)  and  ^2^^^  belong 
to  L(I,  0).  (We  shall  not  prove  that  f|^(x)  and  ^2^^^  integrable, 

since  this  is  a consequence  of  Lemmas  4.2  and  4.4  given  below.) 
Consequently  the  Fourier  transform  of  (4.3.2)  exists  and  is  given  by 


“1  - fT1^(0)■ 


(-10)^ 


so  that  the  expression  in  braces  on  the  right-hand  side  of  (4.3.1) 
corresponds  to  the  n-fold  convolution 


[fl(x)  - £2^] 


Therefore  we  may  deal  with  (4,3.1)  by  j^erforminK  a binomial  expansion 
and  studying  the  integrability  properties  of  convolutions  of  the  type 
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(X)]  * 

for  j “ 0,l,,..,k,  where  denotes  the  mth  iterated  convolution 

of  with  itself. 

Before  proceeding  to  the  main  result  of  this  chajiter,  we  estalilish 
tlie  following  four  lenmas: 

LEMIIA  4.2  If  F(x)  t P(M;  1+6)  for  0 < 6 < 1 and  M(x)  t M*,  then 
fj(x}  t 1(M;  6-y). 


PROOF.  The  symbol  K will  be  used  (here  and  throughout  this  section)  to 
denote  a generic  positive  constant.  Theorem  2.1  inplies  that  e 

1(M,  6);  consequently  by  Fubini's  theorem 


r 


F^l,  (x)  x*^'^ 



M(x)dx  = 


x'^’Vx) 


f^j^ (u)dudx 


r fU 


x*^  ^ M(x)  f (u)dxdu  s 


r°  f 

K u' 

n 


M(u) f ^ (u)du  < 0 . 


LEMTIA  4.3  If  F(x)  e P(M;  1+6)  for  0 < 6 < 1 and  M(x)  t M*,  then 


r“  f 

x"^  M(x)  |f.  (x-z) -f , (x)  |dx  < K z^. 
>2z  ^ ^ 


for  all  z i 0, 
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PROOF.  Clearly  for  0 s z ^ x/2 


- ^iM\  = H'^Cx.z)  + y2(-x»z), 


say,  where 


»^,X,Z)  . F=^,(x)  M 


(x-z)  ^ ^ x^  ^ 


and  t^Cx.zj 


(x-z)  ' ■'x-z 


Since 


KF,..(x)z  lCf,(x)z 
-■  = 

x ' X 


it  follows  by  Lemma  4.2  that 


x'^1(x)  'l',(x,z)dx  < K zx*^  ^ M(x)f,(x)dx 

2z  ^ hz  ^ 


r’  X- 

< Kz^  x'^’^  M(x)£,  (x)dx  < Kz^ 

77  -‘• 


Similarly  since 


4'2(x,z) 


K f^^(J)z 

< r'  ■-  " - 


Lenma  4.2  and  the  fact  that  M(2x)  = 0(M(x))  imply  that 

xVx)  t,(x,z)dx  < K zx^"^'^  M(x)f,,x(i)dx 
J27  ^ >77  ^ 


< Kz’’'^  x‘^M(x)f^j  (Y)dx  < Kz^  . 
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The  next  result  is  included  for  the  sake  of  comjilcteness , since  it 
parallels  Lemua  4.2.  Actually  we  sliall  only  need  to  use  the  fact  that 
f,(x)  e 1(1,  0). 


LEilllA  4.4  Suppose  F(x)  c P(M;  1 + 6)  for  0 < 6 < 1 and  M(x)  e M*. 
Furthemope  assume  that  there  exists  some  positive  aonstant  e < 1 - 6 
suah  that  y^/M(y)  is  increasing.  Then  ^2^^^  ^ 1(M>  "S-y) . 

PROOF.  * ^2^^^’  where 

[ I 1 ) 

- -A  fMjCy)dy 

and  A (x)  = [ j - -jL  1 f (y)dy  . 

>x/2  Hx-y)^  ^ x'*  ^ ^ 

Since  f^J(x)  is  non  increasing,  it  is  not  difficult  to  see  that 
AjCx)  s K x''  . 

Therefore  (using  the  fact  that  M(2x)  = 0(fl(x)),) 


/OO  ^00 

I x'^  ^ M(x)A2(x)dx  s K x*^(x)f  ..x  (4)dx  < ®. 

■'o  ■^o  ^ 

For  0 s y s x/2, 


Consequently  by  Fubini's  theon^ 


()2 


^ 6-y 

X M(x)A^(xJdx  5 K 

0 


^ 6-y 

\ ^ MCx) 


O X 


^(1)  (y)dydx 


= K 


f°°  x.T  cx/2 

x°  ^ M(x) 


-Kf. 

-*0 


Q y f^)(y)tiytix 
r 6-2 

x°  M(x)dxdy 

2y 


s K 


s K 


y^'^  f(i)(y)M(2y) 


2y 


x*^  dxdv 


y°  M(2y3f^j^(y)dy  < » 


Therefore  both  Aj(x)  and  A^Cx)  belong  to  L(M;  6-y)»  proving  the 
lemma. 


LEllllA  4.5  Suppose  F(x)  c P(M;  1+6)  for  0 < 6 < 1 ;ind  M(x)  c M*. 
Furthemore  assume  that  there  exists  some  positive  constant  e < 1 - 6 
such  that  y^/M(y)  is  increasing.  Then  for  all  z • 0, 

r”  ^ 

X M(x) |£,(x-z)  - f,(x)|dx  < K z^. 

^2z  ^ ^ 


PROOF.  It  is  easily  verified  that 

|f2(x-z)  - ^2(2)  I ^ ^ ^2^""^' 

where 


A 
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Jj(x)  = 


x-z 


1 


o Hx-z-y)  (x-z)  (x-y) 


Since  f^j(x)  is  decreasing  and  M(2x)  = 0(M(x)), 


x^^MCxJJ  ,(x)dx  < C x‘^M(x)f,  .(^) 

Jo  Jo  J-  “ 


-,Y 


y ^1-Y 


dx  < K z^^. 


It  is  more  difficult  to  deal  with  Jj^(x):  For  0 < p < 1/2,  A = 1 - p, 
and  z < xl2. 


,x-z 

1 1 

^■(x-z-y)^''^  (x-z) 

1-Y 

s f(-j^^(px) 

(Ax-z)^  (Xx)^ 

zJJ 

+ — 

Y Y 

Y 

vie  can  write 

(Xx)^  = (Xx)J^ 

oo 

(Xx-z)J^  - 

I 

(x-y) 


(x-z)‘ 


j = l 


(-l)j 


where  the  series  converges  absolutely,  since  |z/Xx|  < 1 for  z s x/2. 
Therefore 

. ,.Y-1 


|(Ax-z)J''  - (Ax)"*^!  s K zx 


Likewise 


(Ax-z)x 


Y-1 


Ax-z 


(x-z) 


(z-Xx)xJJ  ^ ^ 


Y+j-1 


j-1  ^ j 


(i)J 
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so  that 


(Ax-z)x^'^  - — ' j -I  s K zx^‘^  . 


It  is  not  hard  to  show  that  ^ L(M;  6)  for  M(x)  e M*; 

consequently,  it  follows  fron  the  above  that 


^"6 

X M(x)J  (x)dx  < K z . 
o 


Now  let  ■122^-’^^  " ■ d22(x)-  Over  the  range  of  integration 


0 < 


px,  we  can  write 

1 

1 

(x-z-y)^’y 

(x-z)^‘ 

(X- 

8 t-v 

1 

X 

H 

j-y  ' 

j=2 

j 

1 X 

M 

X 

• 

^ 8 

' ’7 ! 

x-^  ' 

j=2  > 

- J J 

i 

,1'Y 


- 


where  the  senes  converges  unifomly  in  y.  since  0 < p < 1/2,  and 

(z-^yJ/x  < p + 1/2  < 1.  Therefore  teni-by-term  integration  of  the  scries 
is  permissible,  and 


OD  j-2 

Jl2(x)  = [ [ 

j=2  i=l 


j-y 

j j 


z‘  [“  yj-i  r 

lo 


(1) 


(y)dy. 


Let  V be 


a positive  integer;  by  assumption 


Opx 


y frn(y) 


(l)tyj  I x^^'^^'^Kx^dx 

O ly/p 


■V  r yv 

/ o 


f,nCy)  r 


~ — r y'*  ffnCy)dy  < ®- 

v-e-6  >0  ^ 


l:i  other  words, 


P (v-e-6)  I y f^j(y)dy  t L(M,  6-v-l} 


This  implies  that 


j*2  1*1  Iq 


M(x)  I y^'^  f(i)(y)‘iy 


00  i-lr-  1-  1-  j'i-6 

1 I (1)4)“''  — 

j = 2 i=l  I J j-i-e-6 


.liJ!£V  J fj-Y  j (jj^i^i  pj-i 

l-e-Y  j*2  ^ y i-1  ^ ^ 


K2!i):.^7  J fj-Yl- 

l-e-6  i*2  t.  y / — 


i [':’'!  ‘(7  • »)'  - (t)'  - 


l-e-6  _(l-^p)^'^  (l-or 


-Y  ‘ ,U1-Y 


< K 


Tlieroforc 


b() 


x'^  M(x)Jj2(xJdx  < K , 
o 


com|.lctinK  the  proof  of  the  leinna. 


For  X > 0 define  R(.xJ  = lj(x)  - fjjj(x)  ;in<J 


S(x}  = 


px  l-h,i,(x) 


dx. 


(Take  R(x)  = S(x)  = 0 for  x < 0.)  Clearly  R*(6j  = 1 - 
however,  is  an  increasing  function  of  unbounded  variation,  (since  the 
variance  of  F(xJ  is  infinite) , ajid  therefore  does  not  jxjssess  a 
Fourier-Stieltjes  transform,  liven  so  we  nviy  formally  identify  S(x)  with 
tlie  quotient  [1  - F^j  (0)  ]/(-Uji  0).  R(x)  and  S(x)  play  a role  in  the 
following  representation  for  the  renei.al  function: 


THLOREfl  4.6  Suppoee  thiat  1 c-c./u^  noe  of  iid  positive  i\mdom 

variables  tvith  distribution  fimatiun  F(x)  » P(M;  1^6)^C  for  0 < 6 < 1 
and  M(x)  t M*  such  that 


x^  dF(x)  « ♦ » 

Suppose,  f urtht  Ignore , that  there  exists  son'  positive  aonst^mt  e < 1 - 6 
suah  that  y^/M(y)  is  increasing.  Let  k a 2 be  the  smallest  integer 
“ 0(x*^M(x))  as  X -»  ®.  Then 


r 

> o 


such  that  X 
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t4.3.3) 


M(x)  = y I’{x,  + . . .+  X i x)  = 
n=l  ^ 


= f—  - llu(x)  * [ S(xJ*(R{x)j*^j'^^ 

vMi 


Lj^(x) , 


■^hei'n  function  of  boioulcd  oar-iation  in  ih-  alasa  S(M;  6) 

jcnd,  in  particular. 


Lj^(x)  = o 


1 

x'^M(x) 


as  X -*■  <». 


N.B.  Theorem  4.6  does  not  cover  the  subclass  of  M consisting  of 

functions  M(xJ  which  grow  "almost"  as  fast  as  a fractional  power  of  x. 

For  examiile,  choose  6 = 1/2  and  let  M(x)  grow  asyir^itotically  like 
1/2 

X /log  X.  Tlien  the  variance  of  F'(x)  can  be  infinite,  but  there  exists 

. j. 

no  constant  e < 1/2  such  that  2 /log  y is  increasing.  This 

"boruerlinc"  situation  can  be  dealt  with,  although  the  details  would 

require  extensive  digression;  we  refer  the  reader  to  the  discussion  of  the 

subclass  Mj(p)  in  the  paper  by  Smith  (1967). 

Secondly  we  note  tliat  both  f>  and  M(x)  have  a bearing  on  the  size 

of  k.  We  in^jlicd  in  Section  4.2  that  k should  be  chosen  as  the  smallest 

positive  integer  such  that  1/k  s 6,  and  this  choice  will,  in  fact  yield  a 

valid  exjxinsion.  .Icxever  M(x)  might  conceivably  by  asyinitot  ical  ly  equal  to 
1/4 

(say)  X log  X,  .and  in  sucJi  cases  it  is  fxjssiblc  to  reduce  tJie  number 
of  terms  used  in  the  expansion. 

Finally,  it  sliould  be  jxjinted  out  that  when  6 = 1 expression  (4.3.3) 
reduces  to  the  expiuision  given  in  Theorem  2.4. 
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PROOF_OF  THLOREM  4.6  As  v;e  have  noted  in  Section  2.2,  the  renewal 
function  ll(,\)  does  not  possess  a lourier-Stieltjes  transform,  Con- 
setiuently  we  shall  study  the  transform  of  the  modified  renewal  function 
dcfineJ  by  (2.2.1)  for  0 <■  r.  < 1.  Hv  ITieorem  2.1 

1 - ci-*(e)  = (1-;)  - uj'io  - s'^oj, 

where  s (0)  > l‘(I;  0)  ;uid  s' (9)  = 0.  Writing  (as  before)  6 = fl-C)  * 
' UjiO,  it  is  not  difficult  to  show  that 


1-1^ 

>6' 


(l-0‘ 


aiid  consc'quently  joj  = U((S|)  for  all  Q in  a small  open  interval  I 
centered  about  the  origin,  uniformly  uith  rv'aycet  to  c.  Together  these 
facts  imiily  that  if  0 < 1 , then 


6 


0(1) 


unifonaly  for  0 < c,  < 1.  (Recall  that  A.'^(O)  is  the  characteristic 

(i 

function  of  the  triangular  density  A.  (x).)  defining  H(x)  iind  ff(x)  as 
in  Section  2.2  no  additional  changes  in  the  proof  of  I'lieorem  4.2  are 
needed  to  conclude  that 


(4.3.4)  H(x) 


i r 

' -fi 


A^(0)j 


r-T^, 


(0) 


+ 1 


do 


however  we  now  use  the  formal  expansion  (4.2.1)  as  o;)posed  to  (2.2.7),  where 
the  number  of  terms  is  chosen  to  In?  k as  defined  in  the  statement  of  the 
theorem.  Our  goal  will  be  to  demonstrate  that  the  remainder  term  b|^(0) 
given  by  (4.3.1)  is  a memlicr  of  the  class  1?^(M;  6).  (Since  the  many- 
valued function  for  non- integer  values  of  u occurs  here,  we 


establish  the  following  convention  to  avoid  aril)i>^uity:  Slit  the  complex 
plane  along  the  negative  real  ;ixis  from  0 to  -"s  ;ind  define  z*'*  in 
the  open  slit  plane  when  |arg  z]  < it  by  analytic  cont iniwlion  from  the 
positive  real  axis.) 

As  before  write  r “ 1/1^.  Since  I-^j^(x)  is  absolutely  continuous 
with  density  f (x)  , 


. A A„(0)il-f  C0)1 

(4.5.5)  a:(6)lJ(9)  = -A or: IhL 

[ujr(Y)]'^  i(-iO)^ 


1'^^)^(1)(9)1 

(-iO)^ 


We  recognize  t/ie  right-hand  side  of  (4.3.5)  as  the  Fourier  transform  of  a 
constant  times 

A^(x)M^l(x)-£,(x)]*''  - A^(x)*f^^(x)*I£j(x)-£2(x)]*’' 


Aa(x)*  [ (j)(-l)^  £*-'(x)*f*^‘''-'^(x)  - f^jj(x)'*f*->(x)*f:2^*''j^(x) 


For  ccHivenience  denote  the  k-fold  convolution  f (x)*!’,^^  (x)  as 

1 4. 


I *^(x).  Then  it  will  suffice  to  prove 


£*‘^(x)  - f,,.(x)*f*‘'(x)  . 1(M;  6). 


The  convolution  I "^(x)  can  be  rewritten  as  the  multiple  integral 

(4.3.6)  f . . .1  I (x-u*)f.  (u,)f.  (u  )...  (.  (u  )du,  ...  du.  , 

Ju*  s xJ  h ^2  ^ *3  ^ ‘k  ^ ^ 

where  u*  * Uj  ■••...♦  Uj^_^  and  i^  can  be  either  1 or  2 for  j * 1, 
...,  k.  Without  affecting  the  value  of  the  integral  itself,  the  range 
of  integration  for  (4.3.6)  can  be  replaced  by  the  union  of  k sets. 


^x  ^1  ^ ^2  ^k-1’ 


7(1 


f 


where  S is  the  set  of  (,k-l)  - dimension.i]  points  (u, u,  ) 

A 1 ’ ’ k-1 

sucii  tliat 

u*  + max  USX  jjiu  u*  x. 

l-j<k-l 

aid  for  i - 1,  T.  is  tiic  set  of  (k-lj  - dimensional  jioints 

( Uj , . . . ,u^_  SUCH  that 

u*  + max  u > X,  u*  < x,  aid  u.  = max  u . 

l<j<k-]  J ■ j 

(Aoticc  tliat  although  the  sets  T.  are  not  disjoint,  their  intersections 
fomi  sets  of  measure  zero.J 

Consider  a typical  set  T.,  say  If  (u^ . . . . ,u^, , 7 ^ , then 

14.3.7)  0 X X - u*  ■ u^. 

Set  Vj  = x-u*  aid  = u^  for  j = 2,..., k-1.  I'he  inequality  (4.5.7) 
is  equivalent  to 

maxfx-u*,  u. ,. . . ,u.  , ) • u, , 

*-  X-  1 1 

or,  in  otlier  words 

k-1 

I v . * max  V.  ' X. 
i=l  J lsj‘k-1  J 

I'he  re  fore 
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L'oiiseqiiCMt  ly  we  may  wTitc 


(4.3.9) 


^ (X)  = I IV.  (X). 

j-1  J 


wnere 


l.j(x)  • j ...  I f (x-u«)«.  (Uj)  ...  f (U|^,,)du,  ... 

Q 1 ^ K 


Wjlx)  • ( ...  j'  (Uj)fj  (x-u*Ki  (u_,)  ...  ...  du^ 

^ X ^ K 


anu  so  forth. 

If  (Uj^,. . . c 5^,  then 


X - u*  2 u. 


for  i - l,2,...,k-l.  Therefore  (by  adding  all  (k-1)  inequalities) 


(k-l)x  - (k-l)u*  > u. 


and  this  ijn)lies 


A A 

X - U*  2 T- 


Consider  now  a typical  integral  hj(x),  say  Wj^(x),  and  the 
corresponding  integral 


(4.3.10) 


x/2k 

o 


|Wj(x-z)-W^(x)|  f(jj(z)dz  . 


Clearly  we  can  rewrite 


W^(x-z)  - Wj(x)  - rj(x,z)  - r2(x,z), 


where 


r^(x,z)= 

U*+ 

ajia 

hy  f'ubini’s 


(4.3.11)  = 


1 1’  max 
lsjsk-1 

Consequently 


f f 


. • • J ((X-Z)-U*)-^  (X-U*)k^  (U  )...^  (u,  , 

max  u.sx-j  ^ 1 —'2 


Jdu, 


Ujik-1  J 


1 = 


( • • • I (x-u*)^  (Uj) 

x-z<u*-*-  max  u,<x  ^ ^ 

lsjik-1 


theorem  (usiiii;  x to  denote  the  indicator  {unction) 

fOi) 

x*^  M(x)r,(x,z)dx  = 

j rv  ^ 


f-  II 

r is , 

^ M(X) 

u.2d'  ^ 

^ o 

C [(x-z)-u’' 

- 


-t'.  (x-u*)  . 

1 -I 


■X  iu*  + max  u < x-z[dx}^.  (uj  . 
l5j<k-l  J / / *^2 


f f ( r 


I • • • I ) I (y-^u*)^  M(y+u*) 
; 1 1 >■' ' ' ' 


U^2:U-'  ' •'o 


(y-z)  - ■f;  (yj 

- 1 I - 


^ y't,  then  max  u. 


nax  u s y,  so  that  u*  < (k-l)v. 
j<k'l  ■» 


isj<k 


on  the  ran^e  of  integration  for  the  integral  in  (4.3.11), 


(y+u*)'"  M(y*-u*)  s K y'^  M(y)  . 
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Furthermore,  since  we  are  working  with  0 < z • x/2k  isee  (4.3.10),)  we 
have 


2kz  s y + u*  s y + (k-l)y  = k>'. 


Therefore  we  may  apply  Leima  4.5  or  4.5  (depending  on  whether  ^ o*" 

ij  = 2)  and  conclude  that  the  inner  integral  in  (4.3.11)  is  dominated 
by  Kz^.  On  the  other  hand. 


' 

■ U . 2 O' 

J 


f (Uj)  ...  ...  Ju^.j 

L K 


since  both  f^(x)  and  f^(x)  are  integrable.  It  follcws  that  (for 
0 < z s x/2k,) 


X m(x)  rj^(x,z)dx  < Kz^  < K(1  + z‘'‘M(z))  . 
o 


Next  we  show  that  r2(x,z)  satisfies  a corresponding  inequality: 
By  Fubini's  theorem  (recalling  that  z < x/2k) 


j x‘^M(x)  r2(x,z)dx 
' o 


(4.3.12) 


...  [|  x'^M(x)f.  (x-u*)x{x-z<u**  max  u.<x}dx 

u.20J^J2kz  h lsj<k-l  J 


• ^2^'"!^  ■■■  •••  ^Vl 


Let  y “ x - u*.  Then  on  the  range  of  integration  for  the  inner  integral, 
u*  i (k-l)y,  so  that 

(u^'^y) '^M(u*'*-y)  s Ky'^M(y) . 
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Consequently  tiie  inner  integral  in  (4.3.12)  is  dominated  l)y 


(4.3.13) 


r 6 


K ' 
2kz-u* 


y M(v)£.  (y)x(>’-2<  max  u.  ■ v 
h l-j'k-l  J 


)dy 


Since  u*  < (k-1)  max  u.  , it  folU3v,'s  that 
Isj<k-1  J 


y > 2kz  - (k-1)  nuix  u. 

l<j-k  1 J 


on  the  range  of  integration  for  (4.3.12).  Hut  y < z + max  u. , so 

l<j<k-l  J 

that 

(2k-l)z 

max  u . > , 


Uj<k-1  J 


and  for  k = 2,3,...,  we  have 


max  u.  > 3z/2 

lijsk-1  J 


For  j = 2 , . . . ,k-l  set 


(x)  = -f  . (x)/ 

j j 


f.  (u)du. 

o j 


Let  U.  , Li.  ,...,U.  be  independent  raidom  variables  with  density 
^2  ^3  ^k-1 

functions  g.  (x) , g.  (x),...,g.  (x) , respectively,  and  let  q(x) 

^2  ^3  \-l 

denote  the  density  function  of  max  U.  . Thus  (using  (4.3.13))  it  is 

2sj<k-l 

easy  to  see  that  the  multiple  integral  (4.3.12)  is  dominated  by 


(4.3.14)  K 


3z/2 


( y M(y)f . (y)dy[  q(w)dw. 
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Novs  if  = 1,  then  it  is  not  difficult  to  verify  tJiat 


(4.3.15)  f (X)  * 0 

1 


M(x) 


as  X ► 


To  show  the  same  when  ^ write 


^2^^^  = Aj(x)  ♦ A^CxJ 


as  in  the  proof  of  Lcitina  4.2.  Since  ^ f(M»  is  nonincreasinj’ 

ajid  M(x)  € M , 


(4.5.10) 


x^  'M(x)f,...  (x)  s K [ u'^M(u)f  (u)du 
u;  UJ 


S N 


x/2 


u M(u)  f (u)du  * 0 as  X 


Furthermore 

(4.3.17)  A2(x)  s K x'^f^j^(|). 

and  both  (4.3.16)  aixd  (4.3.17)  imfily  that 


x^**^  ^ M(x)A2(x)  -►0  as  x * 


For  A^(x)  we  can  write 


Aj(x)  s k|a^^(x)  Aj2(x)|  , 


say,  where  for  fixed  A > 0, 


X 


yf(i)Cy)‘iy 


7t) 


aiid 


X 


y f^j^fyjdy. 


Clearly 


Y M(x)A^^(x)  s Ax*^  ^ M(x)  -*■  0 as  x ► ®. 


I-or  X > A, 


Mfx)A,,(x)  = x*^'^  M(x)  [ y'^MCy){-Y"'^ — } 

Ja  S-M(y)J 

s P y^M(y)f(2^^(y)dy, 


which  is  bounded  (and,  in  fact,  c;in  be  made  arbitrarily  small  by  initially 
d\oosing  A sufficiently  large.)  Thus  (4.3.13)  is  valid  for  either 
ij^  = 1 or  = 2. 

Returning  to  the  main  argument,  (4.5.15)  c;ui  be  used  to  show  that 
(,4.3.14)  is  uominateu  by 


3z/2  ^ 


y'  dy>  q(w)dw 


3z/2 


-<  . wV} 


(w+z)'  - w' > q(w)dw 


w^(^)  q(w)dw  ‘ K z' 

3z/2  ^ ^3z/2 


■ K z^  s K(1  + z‘^M(z))  . 


Cl  ( w ) dw 


Therefore  we  have  shcAm  that  (for  0 s z s x/2k) , 
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I x°  M(x)  r;(x,z)ax  s K(1  + z'^UzJ)- 


N'ow  by  Fubini's  theorcn;, 


^<»  , fX/zk 

X m(x) 


HVj(x-z)  -Kj(x)  I (z)  Jzilx 


o ^ ''  2kz 


X MCx)  |Wj^U--)  - Wj(x)ldx|  fjj^(z)dz 


5 K 


l^z"  M(z)|  f^^j(z)dz  < ». 


In  other  words,  for  z s x/2k, 


(4.3.18) 


x/2 


[W^(x-z)  - W^(x)]f^j^(z)dz  f L(M;  6) 


(4.3.18)  can  be  shown  for  V».,(x),  Wj(x),...,  and  W|^(x).  It  follows 
from  the  representation  (4.3.9)  that 


(4.3.19) 


x/2k 


tf*‘'(x-z)  - f**'(x)Jf^j^(z)dz  c L(M,  6) 


Recall  that  our  goal  is  to  demonstrate  that 


(4.3.20) 


£**'(x)  - 


f *^(x-z)f^^^  (z)dz 


f*''(x) 


fCO 


x/2k 


f^^(z)dz  - 


x/2k 


f*''(x-z)-f*^(x)  K(i3U)d: 


x/2k 


I (x-z)f^^(z)dz 


78 


belongs  to  the  class  L(M;  6).  Since 

M(x)  [1  - ^ X -«■  oo, 

*k 

and  I (x)  is  integrable. 


(4.3.21) 


^OO 

x^M(x)£  ^(x) 
o 


/2k 


(c)d2.lx 


Also, 


r f,  * 

XiM(x)  I (x-z)i',..  (z)dzdx 

o -'x/2k  ^ 


(4.3.22) 


< K 


(°°  \ 

x'^M(x)f,j.  (x/2k) 

1 Q V J 


(^  *v 

I ^(u)dudx  < o). 
o 


Together  (4.3.19),  (4.3.21),  and  (4.3.22)  imply  (4.3.20),  .'uid 
consequently 


(4.3.23) 


[1  - 


6^!M;  6). 


■Uj^ie 


This  "smoothing  magic"  is  in  itself  quite  remarkable,  since 
[1  - ^ 6^(M;  6)  and  division  by  -iO  ordinarily  entails  the 

"loss"  of  one  whole  moment.  Apparently  the  additional  k-fold  convolution 
in  the  numerator  of  (4.3.23)  has  the  effect  of  making  the  "lost"  mcment 
"reappear" ! 

By  introducing  the  special  SMF  q*(0)  and  applying  Theorem  2.2,  we 
can  use  (4.3.23),  (together  with  the  fact  that  ^ <5)  ) to 


( 


( 


conduce  that 
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[1  - 


k+l 


c 8+(M;  6), 


1^(1)  (0) 

cuia  hence  that  c s’^CM,  6).  We  omit  the  details  here,  since  the 

argument  is  precisely  the  same  as  given  in  Section  2.2  for  L^fO').  Note, 
however,  that  division  by  a function  in  the  class  8^(M;  6)  precludes 
the  possibility  of  showing  that  is  in  a higher  moment  class,  even 

if  this  could  be  demonstrated  for  the  transfonn  (4.3.23);  in  other  words, 
it  appears  that  we  cannot  improve  on  (4.3.24),  at  least  via  the  Wiener- 
Pi  tt-  Levy-Smith  approach. 

We  have  shown  that 


(0) 


1 

— M^iO  - 


appearing  on  tiie  right-hand  side  of  (4.3.4)  is  the  F'ourier  transform  of 


A^(x-z)dj  I R(z)*  [U(z)  - ^ 

'•  j = l ^ ^ 


A^(x-z)dU(z) 

a 


Proceeding  as  in  Section  2.2  we  then  obtain  the  relationship 

A (x-z)d{  I F (z)l  = 

^ n=l  ^ 


r<*> 

' •oc 


S^(x-z)^U(z)  ^ ♦ d 


- k 


I R(z)*[U(z)-F'  ,x(z)| 

-j=l 


^ i 


j-1 


♦ Lj^(z)  - U(z) 


} • 


The  result  (4.3.5)  follows  by  the  "saiiJwichinj;"  [irocess  used  previously 
together  with  a standard  extension  argument.  As  a by-product  of  our 
discussion  it  is  evident  tliat  the  series 


n=i 


IMX^  +. 


X i 
n 


is  finite  for  every  x. 


CHAPTER  V:  HIGHER  MOMENTS  OF  THE  NUMBER  OF  RENEWALS 


Let  renewal  process  introduced  in  Qiapter  2,  and 

Uefine  the  number  of  reneuals  by  time  t,  as  the  largest  integer 

k such  tJiat 

Xj  . X2  X,,  < t. 


It  is  well  known  tliat  all  the  moments  of  are  finite.  The  familiar 
renewal  equation  asserts  that  H(t)  , the  renewal  function,  is,  in  fact, 
the  expectation  of  To  show  this  let 


if 

X,  +. 

..+  X < t 

1 

r 

if 

Xi^., 

. .+  X > t 
r 

inen  .J  = T Z , and 
t ^ , r 
r=l 


liV 


t 


P{X 

r=l 


+ . . .+  Xj,st)  = H(tl  . 


In  Chapters  2 and  4 we  dealt  with  the  behavior  of  liN^,  the  first 
moment  of  the  number  of  renewals.  We  now  extend  our  study  to  higher 
moments  and,  in  particular,  ‘o  the  second  and  third  cumiiljints  of  i\^. 


j.1  Preliminary  B ick^rcun p 

W.L.  Smith  (1954)  proved  the  following  result  for  the  variance  of 
the  number  of  renewals: 


I 

i 
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ThtOREt!  5.1  (Smith,  1954)  [f  FC-x)  t P(I;  2),  then  as  t -►  <», 

2 

^2  ■ ^1 

Var  = — -3 — - t + o(t) . 

‘^1 


Theorem  5.1  is  a consequence  of  the  Key  Renewal  Theorem  and  the  identity 

= ll(t)  ♦ 2i:(t)*H(t). 

Apparently  this  ty{:)e  of  argument  does  not  generalize  to  higher  moments. 
Using  a different  approach  based  on  factorial  moments  and  expansions  for 
the  Laplace-Stieltjes  transform  of  F(x) , Smith  (1959)  show'ed  that  the 
nth  cumulant  of  .N'^  has  a linear  asymj)totic  form: 


THEOREM  5.2  (Smith,  1959)  If  F(x)  t P(I;  n+p+1)^  C,  p > 0,  then  there 

exist  constants  a and  b such  that  the  nth  cumulant  of  is 

n n t 

given  by 


(5.1.1) 


a t + h + ' — 


where  X(t)  is  a fui:ction  of  hounded  variation,  is  o(i)  as  t ► 
satisfies  the  condition 


A(t)  - A(t-a)  = 0(t'^) 


as  t -►  <»  for  every  fixed  a > 0,  and  when  p > 1 has  the  additional 
property  that  A(t)/(l+t)  e 1(1,  0). 


The  constants  a^  and  b^  are  difficult  to  evaluate;  Smith  (1959) 
listed  their  values  for  n •=  1,2,. ..,8.  a^  is  a function  of  the  first 
n moments  of  F(x) , whereas  b^  is  determined  by  the  first  n+1 
moirient.  Since  the  numiiers  of  renewals  in  adjacent  intervals  viewed  over 
a long  period  of  time  are  approximately  independent,  a cumuliuit  of  the 
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number  of  renewals  in  the  entire  time  span  is,  rouyhly  speaking,  the 
sun  of  the  cuiiiulants  of  the  numbers  of  renewals  in  the  individual 
intervals.  Consequently  the  iisymjitotic  linearity  of  (5.1.1)  is  not 
surprising. 

A familiar  special  case  of  this  result  is  the  following: 


COROLLARY  5.3  (Smitlt,  1959)  if  F(x)  c 0(1;  3)  C,  then  as  t -»•  <», 


Var  = 


U2  - Ml 


t + 


5u2  ^2 

7T  ■ TT  ■ TT 
4u-,  .iMj 


I ‘♦Ml 


+ 0(1)  . 


•An  extension  of  Theorem  5.2  allowing  for  the  existence  of  fairly 
general  moments  was  obtained  by  Smith  (1967) : 

TnEOREi*  5.4  (Smith,  1967;  page  271)  Suppose  r(x)  0(M;  t)  ^ C for 
scweM(x)  s and  some  £ > 1.  Assume  further  that  Mi  > 0.  Then  if  k 
is  the  integer  part  of  I,  there  exist  constants  Aj(£.),  A2(£)  , ..., 
Aj^(£)  such  that 


(5.1.2) 


n=0  '■ 


P{X,  +. . .+  X i x) 
1 n 


= I ^ 1^1  U(x)  + A(x), 

j=i  r(£-j+i) 


where  A(x)  c 8(M;  0) . 


Theorem  5.2  follows  from  Theorem  5.4  by  using  the  fact  that  every  cunulant 
of  can  be  written  as  a linear  combination  of  sums  like  (5.1.2)  . 
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ILxpaiisions  for  cumulants  of  have  been  used  for  statistical 

analysis  of  the  superiiosition  of  a relatively  small  number  of  renewal 
processes.  As  in  Section  5.1  write  for  tlie  variance  of  the 

number  of  events  occurring  by  time  t in  a supeqios it  ion  of  N 
renewal  processes.  Cox  and  Smith  (1954)  orij’inally  proposed  a 
variance- time  curve  .analysis  based  on  the  expansion. 


v.,(t)  - 

^^1 


3u; 


as  t - oo,  wiiere  a = estimated  from  experi- 

mental observations  of  the  supcrjiosition;  see  Cox  and  Smith  (1955).  By 
c^quating  observed  and  theoretical  values  for  the  mc;m  rate  of  occurrence 

and  for  the  asumptotic  slqie  and  intercept,  one  can  obtain  three  equations 

2 

in  four  unknowns:  N,  pj , o , and  p^-  Cox  and  Lewis  (1966;  page  215) 
suggest  using  the  asymptotic  slope  of  the  third  cumulant-time  curve, 


N 


to  obtain  a fourth  equation. 

We  shall  investigate  the  time -dependent  behavior  of  the  seccsid 
and  thiru  cumulants  of  in  Sections  5.5  and  5.4.  In  Section  5.5  we 

shall  prove  a result  (Theorem  5.8)  which  extends  Corollary  5.5  in  two 
directions,  allowing  for  F(x)  e P(M;  3)^^  C and  replacing  the  remainder 

term  ''o(l)"  by  a known  function  and  a much  shaqicr  remainder.  A 
similar  treatment  for  the  third  cumulant  will  be  given  in  Section  5.4 
However  before  pursuing  these  objectives  we  find  it  expetlient  to  resume 
our  discussion  of  smoothing  magic. 


. Smoothing  flagir 

In  Sections  5.3  and  5.4  „e  shall  encounter  Fourier-Stioltjes  trans- 
forms  of  the  form 

(5.2.1)  A^(e)s’^(0) 

> 

-10 

where  S(x)  is  absolutely  continuous  for  x > 0,  and  both  A(xJ  ;ind 

S(x)  vanish  for  x < 0 and  belong  to  the  class  S(^^;  1)  for  some  M(x) 

^ ''<•  We  have  already  dealt  with  a version  of  (5.2.1)  in  Section  2.2, 
where 

Ahe)  . s+(o)  . 1 - 

In  that  situation  discovered  via  the  smoothing  magic  of  Lemma  2.5  that 
the  convolution  (5.2.1)  is  in  the  (unexpected)  ciass  et.M;  1).  he  note 

n*"  nquivalaitly, 

C • '’(i)'’‘»'  • » • 

If,  more  generally. 


(5.2.2) 


can  „e  conclude  that  A^le)  S+(e)/(-i9)  . 6*, Ml  1)2  Theorem  5.5 

provides  an  affimative  answer  subject  to  a certain  growth  restriction  on 
the  right  moment  function  M(x) , 
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ThiLOREtl  5.J  Let  M(x)  « M,  and  suppose  A(x)  and  S(x)  arc  functions 

of  bounded  variation  in  the  class  /<(  [ r'CuJJu;  0),  such  that  both 

' o 

A(xJ  and  S(x)  vanish  for  x < 0, 


r 

S(x)  = I s(u)(Ju,  X > 0, 

'X 


for  some  function  s(x)  e L( 


M(u)du;  0) , and 


dACx)  = 0. 
o- 


Then 


A^(e)  5°^  (6) 

-iO 


X 

M(ujdu:  0)  . 
o 


PROOF.  For  convenience  we  shall  write 


Mj  (x) 


fX 

M(u)du,  X > 0. 
o 


It  is  not  hard  to  show  that  if  M(,x)  f M,  then  Mj  (x)  is  equivalent 
to  a right  moment  function  in  the  asymiitotic  sense  mentioned  in  Section  2.1. 
Consequently  Mj (x)  t M,  and  the  moment  classes  in  the  statement  of 
Theorem  5.5  are  well-defined.  We  want  to  prove  that 

X 


S(x)*A(x) 


’ 

S(x-z)dA(2)  c L(Mj;  OJ. 


We  can  write  this  convolution  as  the  sum  of  three  integrals, 
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I^(x)  ♦ I^Cx)  + Ijlx) 


whe  re 


I^Cx)  = 


{S(x-z)  - S(,x)  } dA(2)  , 


l2(x)  = 


S(x-2)  d\(2) , 


l3(x)  = 


-S(x)  dA(z). 

>x/2 


IVe  shall  deal  with  each  integral  separately 


Clearly 


Il(x)|  5 


x/2  (-X 


|s(y)|dy  |dA(z) 


o ^x- 


By  a change  of  variables  follcxv’ed  by  an  intercliange  of  order  of  integration, 


«>  (x/2  (X 


0^0  ^x-z 


Mj(x) |s(y) |dyldA(z) |dx 


x/2  rZ 


0 'o  o 


M,  (xj  |s(y+x-z)  |dyldA(z)  |dx 


fV  /■<" 

= I Mj (u+v) I s(u+w) |dudwldA(v) 


' O ''  O ^ V 


Note  that  for  x^  i 0 and  X2  ? 0, 


Mj(x  ♦x  ) > Mj(xj)  + [ ^ M(u)du 

^1 


s Mj(x^J  ♦ M(Xj^)Mj(x2) 


Consequently  for  v s 0, 


,V  /oo 


O V 


Mj  (u+ v)  I s (v+w)  I Judw 


V r*” 


{Mj(v-w)  M(v-w)Mj  (u>w) } I s(u+wj  [dudw 


However 


V 

o 


Mj  (v-w)  I s(u+w)  I dudw  < Mj  (v) 


,V  f<o 

1 s Cu+w)  I dudvv' 

o ■’v 


< M,  (v)  u|s(u)|du  = 0(iMj(v)) 

' V 


as  V 


Similarly 


V 

M{v-w)M.  (u+w)  |s(u+w)  |dudvs’ 

o ^ V 


M(v-w)Mj  (z)  ls(z)  |dzdw 


/V 

M(v-w)Mj(z)  |s(z)  |dzd\rf 

- n ‘'V 


nM(v-w)M. (z) |sCz) |dwdz 
o 


Mj(vl  r Mj  (z)  |s(z)  |dz  >■  OG-I,  (V))  as 

i \r 


V ► ®. 


Consequently  I^(x)  f L(Mj,  0) • 
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For  the  second  integral  wc  have 


A 


Mj  (x) 


x/2 


|S(x-2)l  |dA(z)|dx 


2z 


Mj (x) IS(x-z) |dxldA(z) 1 


{Mj(x-z)  + M(x-z)Mj(z)}  'S(x-z)  |dx|d.\(z)  I 
J r,  J 7 ^ ' 


r 

j Mj  (x-z)  |S(x-z)  |dx|dA(z)  I 


O ''  z 


r2z 


M(x-z)Mj(z)  |S(x-z)  |dx|d.\(z)  I 


Mj (x) |S(x) |dx|UA(z) I 


Mj(z3 


M(x)|S(x)|dx|dA(z)| 


f Mj(z3{  r |S(x)ldx}  ldA(z)| 
''o  •'o 


Mj(z){ 


M(x)|S(x)|dx}  |dA(z)| 


Since 


M(u)du|s(x) |dx  < <»  , it  follows  by  another  application  of 


Fubini's  theorem  for  nonnegative  functions  that 

I M(uJ |S(ul |du  < ® . 

* r\ 


t 

I 


Consequently  l2(xj  c LfMj;  0). 

Note  that  A(x)  « 6(1;  1),  since  x Mj  (x)  iuid  A(x)  e 6(Mj(x};  OJ ; 
therefore 


(5.2.3) 


|dA(u)|  = o(-)  as  x 


M.  (X) 

/Vlso,  since  — s M(x)  and 


<o 

M(u)  |S(u)  |du  < oo, 
o 


it  follows  that 


(5.2.4) 


Mj  (x) 
o X 


|S(x) |dx  < ® . 


Combining  (5.2.5)  and  (5.2.4)  we  get 


-*0  ''x 


|dA(u)  iMj  (x)  |S(x)  I dx  < “> 


which  implies  that  l3(x)  c L(Mj;  0).  ITiis  comjiletes  the  proof  of 
Theorem  5.5. 


Suppose  that  the  right  moment  function  M(x)  « M of  Theorem  5.5 
satisfies,  in  addition,  the  conditon 

(5.2.5)  M(2x)  * 0(M(x))  as  x » «. 


(Recall  that  this  growtli  restriction  was  used  in  the  definition  of  the 
class  M*.)  Then  for  some  constant  A > 0, 
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i 

o 


Mfu)du  2 


X 

M(u)du 

x/Z 


X >I(xi 
2 A 


Thus  in  the  proof  of  Tlieorem  5.5  we  can  conclude  that  the  integrals 
lj(x),  I^fx),  and  l3(-x)  belong  to  the  class  L(M;  1),  yielding  the 
follou’ing  result: 


OD^Oy.ARY_5_. 6 Let  M(x)  e M*,  and  euf^pose  A(x)  and  S(x)  are 
functions  of  bounded  variation  satisfying  the  follouTi  ng  conditions: 

(A)  A(x)  and  S(x3  vanish  for  x < 0, 

(B)  For  some  function  s(x)  e KM;  1), 


S(x) 


•CO 

s(u)du,  X > 0, 

X 


and  ( D) 


(C)  A(x)  £ 3(M;  1), 

r 


d,\(x)  = 0. 


Then 


-ie 


Corollary  S.b  is  an  extension  in  one  direction  of  Lemna  2.3,  although 
the  smoothing  magic  in  that  special  situation  applied  when  M(xl  w.cs 
riglit  moment  function  in  the  larger  class  M.  If  M(x)  * explA  ■,  ( 

exam|)le,  then  M(x)  r M,  but 

rx 

M(u)du, 


xM(x)  > 


o 
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so  that  the  conclusion  of  Corollary  5.6  docs  not  necessarily  follow  from 
Tlieorem  5,5.  This  drawback  may  be  due  to  an  analytic  debility  in  the 
proof  of  Theorem  5.5.  We  suspect,  hewever,  that  in  dealing  with  situations 
involving  smoothing  magic  which  are  more  general  than  that  of  Lenma  2.3, 
one  can  not  hope  to  do  better  tlian  the  class  Ai*. 


5.3  The  Variance  of  the  iiumber  of  R^^ewaJ_s 

j* 

In  what  follows  we  write  m (t)  = L\'  for  the  rth  moment  of 

r'^  t t 

and  k^(t)  for  the  corresponding  rtii  cumulants.  Smith  (1959)  introduced 
certain  unconventional  moments  and  cumulant  which  are  advantageous  for 
studying  cumulants  of  the  number  of  renewals.  The  factorial  momentc 
;Pj^(t)  , defined  for  k > 1 as 

0j^(t)  = b((N^.*l)(N^+2)  ...  (N^^k)}, 

are,  in  fact,  the  coefficients  of  in  the  expansion  for  the  generating 
function 

(1-0  ^ 

It  is  possible  to  write  the  factorial  moments  in  terms  of  the  conventional 
moments  by  using  Stirling's  numbers  of  the  first  kind,  and,  conversely, 
the  conventional  moments  can  be  expressed  in  terms  of  the  factorial 
moments  by  using  Stirling's  numbers  of  the  second  kind: 


and 


■ Cl  ‘n'*'  ■ Cl  Cl  • 
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We  shall  require  only  the  simplest  cases  of  these  identities. 

Smith  (1959)  adopted  the  use  of  factorial  moments,  because  the 
Laplace-Stieltjes  transform  of  <l)j^(t)  has  a particularly  convenient 
form.  Throughout  our  discussion  we  have  emj)loyed  I'ourier-Stieltjes 
transforms,  bearing  in  mind  the  possibility  of  extending  our  results  to 
unrestricted  random  variables.  Unfortunately  't'j^(t)  (for  n > 1)  is 
not  a function  of  bounded  variation,  so  that  the  lourier-Stieltjes 
transform  does  not  exist.  To  avoid  this  difficulty  we  introduce 

the  modified  factorial  moment  function 

0jj(t,C,a)  = I (k+1)  (k+2) . . . (k-*-n)|c^  [ Ag(x-z)dFj^(z) T A^(x-z)dF_  ^(z) 

where  0 < C < 1 and  A (x)  is  the  triangular  density  function  defined 
in  Section  2.2. 

For  fixed  n,  Q,  and  a > 0,  a)  is  bounded,  nondecreasing, 

and  absolutely  continuous.  The  following  Icirma  (analogous  to  Lemna  6 of 
Smith  (1959))  shows  that  the  Fourier  transform  of  4>j^(t;  C,  a)  has  a 
familiar  structure: 

n!  aV) 

LEilMA  5.6  <t>Ue;  a)  « r . 

(1  - CF^(e)}'^ 


PROOF.  Transforming  terra  by  term  we  have 


,^(e;C,a)  - I {k>l)  ...  (k*n){cV(e)(F+(9)]’'  - A^0)  [F+(e) 

n k*o  ^ ® * 


n!  a70){i  - j;F^(0)l  I l«;F+(e)]*^  . 

* I j k-0 


n! 


9^ 


By  applying  Newton's  formula  to  sum  the  series  exjiansion ,the  lenma  follows 
ininediately. 

In  order  to  determine  Var  we  shall  first  find  m2(t)  and  then 
apply  Theorem  2.4.  Lernna  5.6  suggests  that  the  transform  approach  of 
Section  2.2  can  be  extended  to  prove  the  following  result: 
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(5.3.1) 


~ <{>2(6;  c.  a) 


A^COJ 


[e-c  — (io)^  - c (io)M  .(0)]^ 

7 h 


Let  I be  a small  open  interval  containing  the  origin.  For  0 t I, 

.2 


|i|2  = 
'b' 


0 


1 2 2 2 

(1-C)  C Up 


and  it  follows  that  |0/6|^  s ^^^^1^  * uniformly  for  0 < ^ < 1. 
Consequently  for  0 c 1,  |0)  = 0(|g|)  unifomly  with  respect  to 

By  expanding  the  right-hand  side  of  (5.3.1)  and  using  the  fact  that 
I0I  = 0(|6|)  we  obtain 


7 07(9 > C»  a)  “ — ^ 


aI(0)  I-  cu.Cie)^  2“ 

1 - o(i0r) 


26 


-2 


Agio)  ( ;U2(ie)^  2 ) 

-V-  1 * otlep) 

ft  I ft  > 


A^O) 


2 

(1  (1*C)  Ut  2(l-Ou,  Uo  •v 

VT  * — 2-7^  * I 2 * -T-f  " ' 

CUj  6 CUi  B rJ  fti 


CUj  B’ 


since  i0  » [(1-c)  - Bj/CUj  • 

For  A > 0 and  n > 0 let 


-Xx  n-1 

e (x;X)  - , X £:  0 

" r(n) 


0,  otherwise. 
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(See  the  proof  for  Theoran  5 of  Smith  (1967;  page  294).)  The 
corresponding  Fourier  transforms  are  cj^(9;  i)  * 1/(A  - iO)".  If  we 
set  A * (1-C)/(CM2).  then  c^uj/6^  is  the  transform  0^(0;  A). 
Write 


E(t,  c) 


^2 

-y-j  ej(t;  A)  + 


2 2 
- C U 1 


2 (1-0^2- 
-n — 

^ i<i 


e2(t;  A) 


(l-C)  W2 

+ 4-3—  e3(t;  A). 


Clearly  if  0 c I , 


(5.3.2)  I ■ Al(e)E''(0;  0 \ = 0(1) 


uniformly  for  0 < c < 1- 

For  0/1  the  difference  (5.3.2) is  bounded  as  C f 1,  since  the 
assun^tion  F^(0)  e implies  tliat  sup|F^(0)|  < 1.  Both  j 

r •••  0^^  h 

and  A (0)  e'(0,^)  are  integrable  for  0/1,  since  A (0)  is 

3 3 

integrable.  Therefore  we  may  write 

I 4>2(t.  C,  a)  - A^(t)*L(t;  O = 

- I*  I ■ A3(0)e''(0;o}c16. 

Setting  (J),(t;  l,a)  - lim  (j),(t;  c,  a)  and  E(t;  1)  = lim  E(t;  c) , it 
^ Ctl  ^ Ctl 

follows  by  bounded  convergence  that 
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i ^^if,  1,  a)  - A^(t)*E(t;  1) 


Ii-F^Ce)]"  (- 


1 ^2  1 

; 7 ¥ c 

Ujie)  UjC-iO)-* 


A formal  expansicffi  of  1/[1  - F^(e)]^  yields 


[l-F^(e)]^  (-Plie)  (i-a-Fj,.(o))]‘ 


(1-F^j^(6))2{3-2(1-F+  (0))} 


1 f A U-F[,a6  r 3-2(l-F 

——■2  U " 2(1-f|  .(0))  . ^ 

^ ^ ^ II  - (1-  fJ,.(0))]' 


1 ^2  ^3  + ^^7  ~ A “2  1 

. ~~:T  * "3 ^ ^ -T  Fr7'>(0)  ^ k+(0)  , 

(-yjie)^  yjj(-ie)  4pJ  _ (2)  _ 


where 


(5.3.3,  K+Ce,  - , 

-PiielFji^(0)]^  ^ -Fjie  ^ 


Note  that  we  have  used  the  facts  (see  Theorem  2.1)  that 

_*  . . l-Ftn(0) 


. i-r 

^(2)'«  ■ ^ 


157  “ 


f(3)<») 


i-FjaCe) 


T — 
3ut 
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Since  M(x)  t M*,  it  follovs  that  (x)  = xM(x)  £ M*  and  consequently 
F(x)  € 2)^  C.  By  the  smoothing  magic  of  Lenma  2.3,  e 3^(M“;l) 

or,  equivalently,  K^j(O)  £ 6^(M;  2).  Note  that  k|2(0)  e 8^(M;  2),  so 
that  both  k|j(9)  and  belong  to  the  class  8^(H°;  1).  Kj^j(x) 

is  absolutely  continuous  to  the  right  of  the  origin  and  vanishes  at 
infinity;  furthermore 

lim  Kt,{0)  ■ 0. 

Therefore  we  can  apply  the  smoothing  magic  of  Corollary  5.6  to  ccsiclude 
that  k|j(0)  * 8^{M“;  1)  or,  equivalently  k|j{0)  ^ 8^(M;  2). 

Setting  J - [-2,2],  z - Fq)  (9)  • ♦(z)  “ 1/z^.  and  t]((0)  - q^  (0) , it 
follows  by  Part  A of  Theorem  2.2  that  K^3(0j  c 8^(M;  2).  (See  the  proof 
of  Theorem  2.4.)  Tnerefore  k|(0)  £ 8^(M;  2). 
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It  is  not  so  difficult  to  handle  the  term 


4 [l-q‘  (e)]  ll-F^,.  (0)  ]^{l+2I-f  . (0)-3[Ff.  - (0)]^) 

kI(0)  =*  ^ 

[1  - ¥Ho)r 


Write  J = (-«■,  2)^(2,  «>) , z = F^(0),  «.(z)  = l/(l-z)^,  and  if/(0)  = 

1 - q'  (0).  Then  by  Part  B of  Theorem  2.2  , 


-^■r  AW  . 6+(„.  3), 
11-FU0)] 

so  that  K^(0)  t 6^(M;  2).  Consequently 


(5.3.4)  k'^CO)  * k}(0)  ♦ kJ(0)  £ 8+(M;  2). 

We  remark  at  this  point  that  Theorem  5.5  can  easily  be  reproved 

using  the  moment  class  8(Mj ; 1)  in  place  of  8(Mj ; 0).  Using  this 
result  with  M(x)  in  the  more  general  moment  class  M,  it  is  possible 

to  show  a bit  more,  namely  that 


(5.3.5) 


K^(0)  6 8 


M(u)du;  1). 


Clearly  (5.3.4)  in^jlies  (5.3.5)  v/hen  M(x)  satisfies  the  additional 

growth  restriction  M(2x)  = 0(M(x)). 

Since  we  iiave  s.iown  tliat 

1 1 ^2 


ll-F^(0)]^  (-Pji0)^  pj(-i0) 


is  tne  Fourier-Stieltjes  transform  of  the  function 


^^5 


2 


it  follows  that 


a:(0) 


I 1 . 1 . ^‘2  ] 

U1-F+(0)]^  (-U^iO)^  n](-i0)i 
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is  the  Fourier  transform  of 


3ui 


~Z  ^ 77  ^'(2) 

Oil , 


4P, 


Therefore 


(5.3.6) 


i 1,  a)  - I A^(t-z)d^|-  ''(5)(z)  + 

•' -<x)  ^ 3m, 


* " A.j(t)*H(t;  1) 

4mi 


Rewriting  (5.3.6)  we  obtain 


4 r A^(t-z)d4.2(z) 

**  -oo 


Ag(t-z)dJ  I t(u;  l)du 
I ) -00 


, 2 
:>M. 


^ Aj^(t-z)d2|U(z) 


3Mt 


- ^2  u^z- 

rr  “3“ 

- - 


* ^(2)  ^^^*^(2)^^^  * 


}• 


As  in  Section  2.2  we  iray  use  a "sandwiching"  process  to  approximate 
characteristic  functions  of  intervals  by  linear  combinations  of  triangular 
densities.  Then  by  a standard  extension  ari;ument  we  obtain 

26, 


- ^2  2M2t- 

<>^(t)  - U(t)  ^ ^ ^ 

- 6l  Ml  - 


36 


3 ^(3)^^^ 
1 
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, 2 
JU  9 

* 2*7  ^(2)  ^ 

U'e  conclude  the  proof  of  Theorem  3.7  by  noting  that  (J)^(t)  -*•  0 as 
t ♦ - oo  by  the  Strong  Law  of  Large  Numbers,  consequently  C = -K(-  <«)  = Q. 


We  now  apply  Theorems  2.4  and  5.7  to  obtain  the  following 
improvement  of  Corollary  5.3: 


TtiEORLM  5.b  If  F(x)  £ P(M;  3)^  C for  some  M(x)  < M* , then  as  t ■*  ®, 


Var  N = t ^ I 

t .0  , . ^ T 0 2,/  J 


''4uj  3p,  2u 


1 


^ ;;3-  ^ * “(tFiftT 


PROOF.  The  argument  is  entirely  straightforward,  although  cor^iutationally 
detailed.  Let  t > 0;  then  by  Theorem  2.4 


2 t 2t 

(Hit)'  “ ^ ^ * 1 ^ 

hi  1 


^2^  ^2 
“r  * ~i 

- hi  hj- 


F(3(t) 


'^2  2 ^2  2t 

-4  * -i  Ff.'iCOLCt)  * ^ L{t) 

4iij  ^1 


> L^(t)  - 2L(t), 


I 


]02 


wlicre  the  rciraintlcr  function  Lft'  is  noiv  in  the  class  6(K;  2J.  ()n  the 

other  hand,  by  Theorems  2.4  and  5.7 


b{.Np 


-2u, 

- 


■3 

^1- 


t + 1 


3u2 


ip 


(5.3.7) 


, 2 
3Ut 


2p, 


* ,T  ^ (2)  ^^^**'(2)^^^  ■ ' (3)^^* 


Sp* 


+ K(t)  - 3L(t), 


where  the  remainder  function  K(t)  is  in  the  class  6(M;  2).  Consequently 


‘t  ■ 


M2-P1 


t + 


= 

. 2 
•5u2 

^"3  "2 

. '“3 

7~i  ' 

73  ^2 

, 3' 

4Fi 

3pj  2pj^’* 

3pj 

F(33(t)] 


U2t 

(1  - ^ 


where  R(t) 


% [1  - F(2)(t)]  ^ ^ [1  - 


7T 


2p 


1 


4p 


1 


3p  * 

tl  - F(2)(t:)*I72^(t)J  - L(t)  - l.^(t)  + K(t) 


2u 


^ L(t)  - 4 F.,.(t)L(t). 

pj 


Since  » 
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t 

I 


i 

t 


LM(t)Il  - s 


r 


uM(u)dl-^2) 


as  t » ®,  so  that  [1  - " o(l/tM(t)J. 

shown  that  every-  term  in  the  expression  i'or  R(t) 
t > 00.  On  tlie  other  hajid,  both 


It  can  similarly  be 
is  oCl/tM(t))  as 


2m--  M-,t 

^ [1  - F^3^(t)]  and  [1  - r^^^(t)] 


are  of  magnitude  o(l/tM(t))  as  t -+■  oo , 


.•\n  immediate  application  of  Theorem  5.3  is  the  following: 

COROLLARY  5.9  If  V^(t)  is  the  variance  of  the  number  of  events 
ojourring  by  time  t in  a superposition  of  N iid  renewal  processes  with 
Lifetime  distribution  F(x)  e I?(M;  3)^  C for  M(x)  . M*,  then 


ul  ^ ^ 2uJ  3mJ  ^ 


1^ 


Nu.t 

3-  [1  - F^23  J 

Ml 


2Nm, 


3m 


3-  [1  - f-(3)Ct3] 


■*■  o 


1 

tMTty 


as  t > 


2 

where  Mi  aenotes  the  ith  moment  of  F(x) , and  a 


M2  ■ M 


(.orollary  b.9  could  conceivably  be  used  develop  an  imj)rovcd  variance-time 
curve  approadi  for  statistical  analysis  of  suiierposition. 
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The  mcthcxis  used  to  prove  n\eorcnis  5.7  iind  S.ii  ciui  be  emii loved  to 
obtain  detailed  expansion  for  the  nth  cumuhint  (semi  - invariant)  of  N'^. 
Toi  n = 3 we  can  shovs  the  follcRving: 

TME0_Rm_5,.Jp  Tf  I-(x)  t P(M;  4)^  C for  some  .M(x)  • M*,  then  as  t - co, 


k,(t)  = - 

= 

- i_  _ ^ 

51J4 

Pi  3 

- -1  * 

-T*  i"  " 

- "1  Ui 

‘^1 

^1  - 

4ui 

3p  t^  2u  t 

- [1  - 

■ ^ ‘ ' "iMitrl  ■ 

OUTLINE  OF  PROOF.  Since  the  proof  is  analogous  to  that  of  Theorem  5.S, 
we  shall  describe  only  the  major  steps  involved.  The  tliird  cumulant  of 
can  be  written  as 

k.(t)  » LN^  - 3EN^L\^  + . 

We  have  already  developed  expressions  for  liN^  and  liN^.  To  obtain  ;m 
expansion  for  ni^Ct)  = liN^  we  need  a result  similar  to  Theorem  5.7  for 
the  factorial  moment 

PjU)  - b|(?J^>l)CM^^2)(N^*3)J  . 


/Uthough  4>3(t)  (iocs  not  possess  a I'ourier-Stieltjes  transform,  a 
formal  expansion  anJ  application  of  Theorem  2.1  yielJ 
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3! 

{1-I^(e)}^ 


OIW- 


1 


3m- 


ijy  lij  -iO  iJjC-iO)*"  u^(-iO) 


* —K  fJ .1^(03  - Fl,,(01fy,,(0) 


7^*3 


7 '(2)^”'' (3) 


2^3  i J-jUt  i -i  i 

T-f(3)«*)  • ^ • che). 


wnere 


c^(0j  - * 0(i-Fj^3(e))^ 


ine  smoothing  magic  of  Lenma  2,3  and  Theorem  5.5,  together  with  Theorem 
2.2  O'/iener-Pitt-Levy-Smith) , can  be  used  to  show  that  C^(e)  e 6^ (M;  3) 
By  introducing  a modified  factorial  moment  function  4>3(t;  C.  a)  and 
following  the  lines  of  the  proof  of  Theorem  5.7,  we  obtain 


- .3  Ou  t*^ 

^jCt)  = U(t)  ^ > 

- Uj  2p^ 


9u2  5^3 

-T'  ' T" 


15u2  3ij-g, 

^ ^ *'(1)*^(1)*^(1)^'^^  ■ ^'(2)  ^'^^**'(3)'^^^ 

Uj  ^ 4pj  ^ ^ 


wiiere  C(t)  t d(M;  3),  C(t)  vanishes  for  t < 0,  and 
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C(t)  = o 


tAl(7) 


as 


a>. 


Iheorem  2.4  aiid  (5.3.7)  in  the  pioof  of  Theorem  5.8  can  be  applied  to 
develop  an  expansion  for  m,(t).  The  desired  result  follows  after  a 
considerable  amount  of  computation  and  sijTij)lification. 


Using  tlie  methods  of  Dieorems  3.8  and  5.10  we  can  find  expansions 

when  n > 3,  although  the  com{)utation  involved  is  formidable. 

In  general  we  need  to  assume  that  r(x)  ^ fi(M;  n+1)  C for  some  M(xl  <-  M*; 

n 

then  there  exist  constants  a^,  b^,  c^^^  > ^5’  S n+1 

(5.3.8)  k,(t)  . . T * “f-h" 

as  t -►  ®.  Although  (5.3.8)  suggests  a sharpening  of  Theorem  3.2,  botli 
in  terms  of  the  generalized  moment  assumjition  and  the  more  detailed 
remainder  term,  the  constants  involved  are,  nevertheless,  difficult  to 
evaluate.  Further  work  (most  likely  requiring  the  use  of  deeper  confci- 
natorial  methods)  is  needed  to  establish  (5.3.3)  rigorously  and  to  provide 
usable  algoritims  lor  canputing  the  constants. 


CHAPTER  VI:  MOMENTS  OF  THE  FORWARD  RECURRENCE-TIME 


Given  a sequence  of  renewal  lifetimes  foruard 

veaurrenae-time  is  defined  as  the  time  measured  forward  from  t to 

the  next  renewal.  In  other  words,  is  the  residual  lifetime  of  the 

component  in  use  at  time  t.  We  shall  write  G^(x)  = s x}  for  the 
distribution  function  of  Using  a familiar  renewal  argument  it  can 

be  shown  that 

(6.0.1)  P{c^  > x}  = 1 - G^(x)  = 1 - F(t+x)  + [ {l-F(t+x-u)}dU(u)  , 

where  F(x)  = P{X^  s x}  and  H(t)  is  the  renewal  function.  By  applying 
the  Key  Renewal  Theorem  to  the  right-hand  side  of  (6.0.1),  it  follows 
that 

X 

(6.0.2)  lim  G (X)  = f du=F.,>(x), 

t-Ko  ^ ■'o  Uj 

provided  F(x)  e 0(1;  1). 

Using  Wald's  Identity  and  the  Second  Renewal  Theorem  one  can  prove 

that 

(6.0.3)  * o(l)  as  t •♦  <*>, 

assuming  F(x)  f 0(1;  2).  Apparently  this  approach  does  not  yield 
similar  expressions  for  higher  moments  of 


108 


In  Section  6.1  we  shall  describe  a method  for  obtaining  refined 

estimates  of  the  moments  of  Aji  application  of  the  expressions 

2 

derived  for  and  E[c^]  will  be  given  in  Section  6.2,  which  deals 

with  the  variance  of  the  number  of  renewals  in  an  interval  away  from  the 
origin.  Tliis  result,  in  turn,  can  be  used  to  find  the  covariance  of 
the  nunbers  of  renewals  in  disjoint  intervals. 

G.l  Estimates  for  and  E[;‘] 

Define,  as  usual,  S * 0 and  S = X,  ♦...+  X for  n ? 1.  Since 
o n 1 n 

the  "overshoot"  can  be  written  as 

^t  ' ^^+1  ■ 

it  follows  that 

00 

(6.1.1)  ^ ^ * I l)' 

^ i=l  ^ ^'1 

vdiere  U(x)  « P{0sx}  is  the  unit  function.  (6.1.1)  is  a version  of  a 
more  general  identity  which  has  been  used  in  the  study  of  cimulutive 
renewal  processes.  By  taking  the  exjiectation  of  both  sides  of  (6.1.1)  and 
using  the  independence  of  X^  and  we  obtain 

cCj  ♦ t - Ujd  ♦ H(t)}. 

Assigning  that  F(x)  € P(M;  2)^  C for  some  M(x)  f M,  an  application  of 
Theorem  2.4  yields  the  following  refinement  of  (6.0.3): 

■"‘t  ■ ^7  ■ ^ f (2) wi 

where  L(t)  ■ o(l/tM(t))  as  t -►  <*>. 
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Using  (6.1.1)  ais  a starting  point,  we  can  develop  similar  ex])ressions 
for  higher  moments  of  although  the  calculations  involved  are 

lengthy.  We  now  derive  an  estimate  for  n(c^]  to  illustrate  the  approach. 
By  squaring  both  sides  of  (6.1.1),  it  follows  that 


= I Xf  U(t-S.  ,)  >2  n XX  U(t-S  ) 
^ i=l  ^ ^ ^ r>s>l  ^ ^ ^ ^ 


since  U(t-S^_ j)U(t-S^_ P * U(t-S^_2)  if  r > s.  This  implies  that 


(6.1.2)  ^{(c.n)^)  - wpi^H(t)}  > 2m,  n IHX  U(t-S^  ,)} 

^ ^ ^ r>s?l  * ^ ^ 


Using  F ”(t)  to  denote  the  nth  iterated  convolution  of  F(t)  with 
itself. 


. X^P{S^.J  s t|X^) 

- Xj  . Fj(  (t)*  F*t''-2)(t), 


where  Fy  (t)  * Ky  •>  (t)  • Therefore 

Xj  (A^,ooJ 

(6.1.3)  E{X^U(t-Sj..p|Xp  « Xg  ,„)(t-u)dF*^*''^^u) 


By  taking  expectations  on  both  sides  of  (6.1.3)  and  applying  Fubini's 
theorem,  we  obtain 

c. 

C C“ 


E{X^U(t-S^.p}  - ^ I”  xI^^^^j(t-u)dF(x)dF*^'^ 


-2) 


(u) 


^ xdF(x)dF*^’^'^^(u)  - R(t)*F*^*“^^(u), 


where  R(t)  ■ f udF(u). 
■^0 
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Clearly  is  the  distribution  function  of  a fxjsitive  random 

variable.  (It  is  interesting  to  note  that,  in  particular,  Uj^R(x) 
arises  as  the  limiting  distribution  as  t -►  «>  of  the  length  of  the 
renewal  lifetime  containing  t or,  in  other  words,  the  total  life  of  the 
corni^onent  in  current  operation  ; however,  in  the  present  context  Uj^^R(x) 
does  not  appear  to  have  such  an  interpretation.)  For  k = 1,2,..., 

r k r k+i 

t^dRCt)  = t*'  " dF(t)  = y.  ,, 

^ o ' o ^ 

i.e.,  the  kth  moment  of  yj^^R(t)  exists,  provided  F(t)  t P(I ; k) , and 
is  equal  to  Consequently  Theorem  2.1  can  be  used  to  develop 

expansions  for  the  characteristic  function  of  vij^^R(t),  and,  furthermore, 
it  can  be  shown  that  the  Fourier-Stieltjes  transform  of  R(t)  is  given  by 

(6.1.4)  R^(0)  = -iF^'(O). 

Therefore  l:{X^U(t-S^_^) ) has  Fourier-Stieltjes  transform 

R^(0)F^(9)  - -iF^'(0)[F^(0)]'"^  . 

Since  the  double  sum 

S(t)  - II  E{XU(t-S^J) 
r>s?l  * ^ ^ 

is  nondecreasing  but  unbounded  as  t -*  ®,  it  does  not  possess  a 
legitimate  Fourier-Stieltjes  transform.  This  difficulty  can  be  overcome 
by  introducing  a smoothed  bounded  modification  of  S(t) . We  have  already 
employed  such  a procedure  in  Sections  2.2  and  5.3,  and  rather  than  duplicate 
those  argiancnts  here,  we  siiall  sir^ily  use  transforms  defined  in  a formal 
sense.  (N.B.  Since  we  are  dealing  entirely  witJi  positive  random  variables, 
this  technicality  could  be  conveniently  eliminated  by  working  with  Laplace- 


m 


Stieltjes  transforms;  however  this  would  preclude  possible  future 
extensions  to  unrestricted  random  variables.) 

The  formal  Fourier-Stieltjes  transform  of  S(t)  is  given  by 


S^O) 


iF^  (0) 
— 1— ''2 


1 

I-F^CgT 


Formally  1/[1-F^(0)]  corresponds  to  the  renewal  functicai  + U(t) , 

and  we  recognize  "-i  d/dS"  as  the  "first  moment"  operator. 

Assuming  that  F(x)  t P(M;  3)^  C for  some  M(x)  € M,  it  follows 
from  Theorem  2.2  that 


Note  that 
-iL+’(0), 

(6.1.5) 


S(t) 


ft 

o 

2 


ud[H(t)  + U(t)} 


. t“  m2 

1 2uj 


udF^2)(^)  I udL(u). 


i: 


udL(u)  belongs  to  the  class  8(M;  1)  and  corresponds  to 
o 

where 


L^e) 


[1  - 

1 - F^(0) 


Differentiating  (6.1.5)  with  respect  to  0 and  using  the  facts  (see 
Theorem  2.1)  that 


1 - Ft(0)  - -UjLieF*jj(0)  and  1 - (6) 


’^2  . + 

2^  iOF^2)  f®)* 


we  can  show  that 


lim  (0) 

0-m 


2 

'"2 

4pi 


Therefore 
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2 

L(t)  . X . as  t ■ ». 

4u, 


By  expanding  the  left-haiiU  side  of  (0.1.21,  substituting,  and 
collecting  terms,  v.e  obtain 


(0.1.6) 


U2t 


[1  - 


TT  ■ ^(2)^’^^^ 


udF(2)(u)  ■*■  o( 


tMUT 


j as  t ► 


F-or  large  t the  first  term  on  the  right-h<'ind  side  of  (6.1.6)  is 
o(l/M(t));  the  second  term  is  o(l/LM(t)).  Since  the  first  manent  of 
the  second  derived  distribution  is  Uj/3u2. 


lim  E[c^] 
t-»o 


This  is  not  surprising  in  view  of  (6.0.2),  since  the  second  moment  of  the 
first  derived  distribution  is  Pj/Suj. 

The  following  result  summarizes  the  preceding  discussion: 


THEOREM  6.1  Suppose  F(x)  e 0(M;  2)^  C fur  some  M(x)  < /(.  Then 

If  additionally  F(x)  c P(M;  3)^  C,  then 

^ I'  ■ '’(2)">i  * ^ \\  “^'■■(2)M  ♦ “Itnk)  “ ‘ 
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By  raising  both  sides  of  (6.1.1)  to  the  nth  power  ajid  taking  their 
expectations,  it  should  be  possible  to  find  ;in  expansion  for  with 

a remainder  term  of  magnitude  o(l/tM(t)).  Undoubtedly  this  entails  the 
assumption  that  F(x)  e P(M;  n+1)^  C.  The  computation  involved  for  each 
n 2 3 is  formidable,  but  it  may  be  jiossible  via  more  extensive  combi- 
natorial work  to  obtain  a closed  expression  for  the  nth  moment  of 
It  can  easily  be  shown  using  integration  by  parts  that 


r k 


^k^l 

(k^D/iij 


One  might  therefore  suspect  that 


(6.1.7) 


, • r-r.ni  _ ^n+1 

lull  = ; 

t*«  (n+l)/p^ 


in  fact,  (6.1.7)  is  a consequence  of  the  follcwing  fact  which  will  later 
prove  useful  in  a different  setting: 


L£HHA  6.2  Suppose  F(x)  e P(M;  1)^  C for  some  M(x)  c M and  fe  the 

00 

fomxird  recurrence -time  corresponding]  to  the  renewal  lifetimes 
with  distribution  F(x).  Then  there  exists  an  absolutehj  continuous 
distribution  function  D(x)  c P(M;  0)  such  that  D(0)  = 0 and  for 
X > 0, 

> x)  - 1 - G^(x)  s 1 - D(x),  (t  > 0). 

PROOF.  By  the  uniformly  bounded  variation  (UBV)  property  of  the 
renewal  function,  there  exists  a constant  A > 0 such  that  for  all 
u > 0, 


I 

I 

I 


» 

I 


h(u  + 1)  - iUu)  ^ A. 
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lAi though  the  UBV  property  follows  from  Theorem  2.4,  it  caii  be  obtained 
directly  without  the  aid  of  such  a strong  result  and  iias,  in  fact,  been 
used  by  authors  to  prove  tlic  elementary  renewal  tlieorem.)  Let  A'  = 
ma.\(A,  1,  then  by  (6.0.1), 

[tlM  fj 

1 - G (x)  s 1 - F(t+x)  * I {1  - |•(t*x-u)  }dll(u) 

j=l  j-1 


ItUl 

s 1 - F(t*x)  + I [1  - F(fx-j)][M(j)  - ll(j-l)] 

j = l 


(t]-l 

s A’  I [1  - F(t^x-j)] 
j*0 


s A' 


rlt]+2 

[1  - F(t+x-u)]du 


s PjA'd  - F^j(x>t-[t]-2)]  < UjAdl  - F^jj(x-2)J. 


Define  D(x)  = 0 for  x < 2.  Since  (x)  is  absolutely  continuous 

and  pjA'  > 1,  there  exists  a constant  A > 2 such  that 

pjA' [1  - F^J{x-2)]  * 1.  Take  D(x)  = 0 for  2 < x s A,  and  define 

1 - U(x)  = u^A'Il  - F^jj(x-2)I,  x > A. 

It  is  then  easy  to  verify  tliat  D(x)  has  the  properties  claimed  in  the 
statement  of  the  lemma. 


Returning  to  (6.1.7),  we  can  apply  Fubini's  theorem  to  write 


1 1 nu”  ^ dudG  (x)  = 

1 

nu”-* 

0 

dG^ (x)du 


I nu^  ^(1  - G^(u)]du  . 

^ n 
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By  Lenriii  6.2  and  I'ubini's  theorem 


nu^  ^ [ 1 - (u) Jdu  < 


nu”  ^|1  - D(u)]du 


= f" 


^ o o 


nu^  ^ dudD(x)  = 


X dDfx)  < >», 


provided  F(xJ  t 0(1;  n+l) . Convergence  of  moments  (6.1.7)  follows  by 
dominated  convergence. 


£.2  The  Variance  of  the  dunijer  of  Renewal^  j n ji n_ _I aj_ 

From  the  Origin 

Since  the  forward  recurrence- time  plays  a role  in  the  study  of 

modified  renewal  processes  and  occurs  in  a number  of  applications  (such 
as  counter  models),  tlie  results  of  the  previous  section  should  be  useful 
in  a variety  of  situations.  Here  we  shall  use  Theorem  6.1  to  derive 
estimates  for  the  expectation  and  variance  of  the  number  of  renewals  in 
an  interval  away  from  the  origin. 

Write  N(t;  T)  for  tlie  number  of  renewals  occurring  in  the  time 
interval  (t,  t ♦ T],  t > 0 and  T > 0.  We  assume  that  t is  fixed 
(with  respect  to  T)  aind  is  moderately  large  in  the  sense  that  does 
not  necessarily  possess  the  limit  distribution  given  by  (6.0.2).  Further- 
more we  suppose  F(x)  e y(M;  2)^  C for  some  M(x)  < M.  Then  by  Theorem  2.4 

(T-CJ  M. 

(6.2.1)  lU[N(t;  T)-l]  ^ ''(2)^'‘'''^t^  ^ L(T-c^), 

1 ^^1 

where  L(x)  e B(M;  1).  (We  subtract  one  renewal  from  N(t;  T) , since 
ITieorem  2.4  applies  to  renewal  processes  whose  first  lifetime  begins  at 
the  origin.) 


If,  moreover,  F(x)  ■ PI.M;  3)  C for  some  M(x)  < M*,  then  (5.5.7J 


in  the  proof  of  Tiicoran  5.8  imjilics  that 


t6.2.2) 


, (T-CJ'-  I-  2u 

IH  (.\(t;  Tj-D^lr^}  = * 


2 5 


P,  Wj- 


(T-C,) 


+ 1 - 


3p; 


^^2  ^^2  ^^3  ^^^2 

2uj  2u^  3ijj  2mj 


[1  - 


^ 11  - l-(2)*''(2)^'‘--n^ 


-’Pl 


jp, 


11  - l->3)('r-^t^l 


^ k(T-c^  - 3L(T-c^) 


where  both  L(xJ  and  F (x)  belonj;  to  6f.M;  2) . 

By  taking  the  expectations  of  both  sides  of  (6.2.1)  and  (6.2.2J  we 
obtain  the  (ratlier  complicated)  exjiressions 

E{N(t;  T)}  = ^ ^ ^ 

1^1  ^1  2ur  1^-'  ^ 


and 


2 j2  2Tlic  li[d] 
E{lN(f,  T)]^}  = -L,  - —^-1  > — ^ 


Pi  Pi 


- 2p2 
.*) 

3 

(T-i:c,) 

+ 1 - 

3^2 

rr 

- 2 
jp- 

* rr  ■ 

T 5 

1 

"i 

I'r 

1 

2Pi 

2p  j 

3pj 

3p, 

, 2 
Jp, 

4* 

— 2 
2pj 

(1 

L 

- -p( 

2Pi 

11  - 

i:  *t: 

'(2) 

*( 

(2)  ^ 

2p3 

3ij  2 

[1  ■ 

■ ‘■'(S) 

,%(T)] 

+ K*C^ 

.(T) 

- 51. 

(T). 

Alter  applying  Theorem  6.1  the  above  expressions  can  be  comliincd 
and  simjilified  to  yield  estimates  for  I;{N(t;  T) } and  Var{.N(t;  TJ ) , 

U’e  omit  the  details,  since  the  comjjutation  involved  is  awkward  but 
straightforward.  It  is,  however,  worth  mentioning  tliat  terms  such  as 
1 - order  of  magnitude  o(l/TM(t))  as  T - <» 

unifcmly  with  fespeot  to  t;  this  is  not  difficult  to  show  with  the  aid 
of  the  following  lenma; 


LEi1i-lA  G.3  If  F(x)  f P(M;  3)^  C for  aome  M(x)  - M* , thf'  inteuval 

xM(x)dF^2)*S^''^ 

converges  uniformly  unth  respect  to  t. 

PROOF.  Since  M(x)  e M* , there  exists  a positive  constant  C such  that 

vM  (v)  s C f M(u)du,  (v  > 0) . 

-*0 

Furthermore,  since  possesses  a density  fj-^^Cx),  the  convolution 

Fj^2)*0t(x)  is  absolutely  continuous  with  density 

/X 

(v). 

J o ' ''  ^ 

by  Theorem  2 . 1 

A = I vrf>l(w)  f ^2)  (w)dw  < ■». 


Using  Fubini 's  theorem,  for  fixed  T > 0, 


(6.2.3) 


XjM(x) 


i-,.(x-v)a(;  (v)jx  = 
o ^ ^ ^ o 


T /r 


x^j(x)f^2)^^''^•J‘^'^^t^v) 


T rT-v 


o 'o 


(v+w)M(v+w)  f ^2)  (w)dwd(:^  (v) 


J-v 


vM(v) 


M(w)f^2)  (w)dwd(;^(v; 


T /r-v 

.M(v)  \v'M(w)f (w)dK'd(;  (v) 

o 'o  ^ ^ 


s 2AC 


(T 

io 


V rT 

M(u)dudG  (V)  = ZAC  M(u) 
o ' o 


dC^(v)du 


s ZAC  j M(u)[l  - G (u)]du  . 

J n 


By  Lenma  6.Z  and  Fubini's  theorem, 
fT 


ZAC 


M(u)[l  - G^(u)]du  s ZAC 

r 

i ZAC  uM(u)dD(u)  < <». 


M(u)[l  - D(u)]du 


The  lenma  follows  by  taking  t.he  limit  as  T ► of  the  left-hand  side 
of  (6.2.3). 


As  a consequence  of  Lenrui  6.3, 

TM(T)[1  - F(2)%(T)]  s xM(x)d}-^2)*^’tW  " 0 

uniformly  in  t as  T •♦  “>,  so  that 


We  have  iiou  obtained  the  follc»»ing  result: 


iiy 


TH_EPREri  6.4  Suppose  I'(x)  f P(M;  2)^^  C for  some  M(x)  > M*  and  that  t 
is  fixed  but  moderately  lar<je.  Then  as  T ► •», 


2u 


addition. 

F(x)  < 

: PCNU 

Var{N(t;  T) } = T 

- ^2"! 
~T 

1 

- ^^1 

c 2 

5u2 

^2 

* TT 

3 

-fl.  * 

4mi 

^^1 

2Mj 

P2t 

~r 

[1  - 

°^tMkr^ 


2P: 


U2T 


U I 

* oItmTtT^  ■ 


Using  Theorem  0.4  we  can  estimate  the  covariance  of  the  niuifcers  of 
renewals  in  contiguous  intervals: 
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COROLLARY  6.5  Suppose  F(x)  e P(M;  ^ some  M(x)  ► M*  that 

N(0,  Tj)  and  N'(T^,  T^)  are  the  numbere  of  iH^neualo  in  the  intervals 
(0,  T^]  and  ’ respectively,  where  is  fixed  with  respect 

to  T2.  Then 


-Su 

(6.2.4)  Cov(.N(0.T,).  N(T,.T^))  - o(,.‘  ^ ^ ^ 

1 1 oUj  2iJ  j 


* °tT3iTTrr)  - ¥ 1'  - f(2)(Ti)i 

1 1 lij  ^ 


7^ 

2u, 


udF^2) 


^3 

7^ 


3vi 


1 


2m 


3 — I'  - ^(2)nvv^  * 


^2'^2 


3m 


I I'  - ^3)\n'2)]  -^(1  - F(2)\(V1 


PROOF.  If  X ajid  Y are  random  variables,  then 
(b.2.5)  2Cov(X,Y)  - Var(X^Y)  - Var  X - Var  Y . 

Theorems  6.4  and  5.8,  together  with  this  identity,  imply  the  corollary. 
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Corollary  6.5  has  an  immediate  application  to  the  superposition  of 
renewal  processes.  Suppose  that  (as  described  in  Chapter  3)  N iid 
renewal  processes  are  superposed  and  that  N*(0,  Tp  and  N*(Tj,  T^) 
denote  the  numbers  of  events  occurring  during  the  time  intervals  (0,  T^] 
and  (Tp  respectively,  for-  the  euper^ioeition.  Then 

^ Cov(N*(0,  Tj) , N*(Tj^,  T2))  is  given  by  (6.2.4). 

Finally  we  note  that  the  identity  (6.2.5)  can  easily  be  extended  to 
sums  of  more  than  two  random  variables.  Theorems  6.4  and  5.8  can  then 
be  used  in  a straightforward  fashion  to  estimate  the  covariance  of  the 
numbers  of  renewals  in  non-adjacent  time  intervals. 


APPEiJDIX:  PROOF  OF  THEOREM  2.2 


W.L.  Smith  (1967)  proved  a version  of  the  Wicncr-Pitt-Levy 
result  in  which  it  is  assumed  that  the  moment  function  M(x)  belongs 
to  the  somewhat  restrictive  class  M* ; see  Tlieorcm  2 of  Smith  (1907; 
page  270).  Later  in  a study  of  the  theory  of  recurrent  events.  Smith 
(1976)  introduced  the  broader  class  M and  extended  his  earlier 
theorem  to  include  moment  functions  M(x)  in  M;  see  Theorem  3.1  of 
Smith  (1976;  page  41).  Our  Tlieorem  2.2  differs  from  the  former  only  in 
tliat  we  have  used  the  class  M rather  than  M*.  However,  since 
Tlieorem  3.1  of  Smith  (1970)  refers  to  Fourier  scries  rather  than 
Fourier-Stieltjes  transforms,  we  liave  found  it  necessary  to  make  some 
non- trivial  clianges  in  the  proof  of  Smith's  earlier  result.  Fortunately 
several  tecluiical  leimias  needed  to  carry  out  the  modifications  arc 
given  in  Section  3 of  the  study  by  Smith  (1976),  and  we  shall  simply 
quote  these  without  proof. 

Tiie  essential  tool  used  by  .Smith  (1967)  to  prove  Theorem  2 is  the 
smooth  mutilator  function  (SMF)  written  as  q'(6;  a,6,Y.6).  However 
the  SMF  developed  by  Smith  in  his  1967  paper  is  inadt'quate  when 
H(x)  « M,  and  consequently  Smith  (1976)  later  constructed  a refined 
smooth  mutilator  function.  This  new  Sffl-  has  the  projiertics  described 
in  Section  2.1,  and,  furthermore, 

“ ^ 1 e q^(0;  a,8,Y.6)d0 
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belongs  to  the  class  l.(M;  v)  for  any  M(x)  » M und  any  \>  > 0.  Ihe 
construction  given  by  Smith  (1970;  pages  41-48)  is  entirely  adequate 
for  our  puq^oses,  iuiu  we  refer  the  reader  to  that  paper  for  the  details 
in  order  to  avoid  duplicating  then  here. 

We  first  prove  Part  A of  ITieorem  2.2.  (I'or  convenience  we  shall 
use  the  notation  of  Smith  (1907,  pages  235-287).)  I.et  0^  be  any  fixed 
point  in  the  compact  interval  .1  (jxjssible  ;in  end-]K)int) . Then  4'(2) 
is  analytic  at  z = <{i(0^)  and  therefore  has  the  Taylor  expansion 

CD 

^(z)  = 0(4.(0 J)  > [ c (z  - 4.(6  ))" 

° n=l  ° 

about  the  point  z « 4>(0q)  witli  a strictly  positive  radius  of  conver- 
gence (say)  Pq.  Since  4i(0)  is  continuous,  there  exists  a constant 
6^  > 0 such  that  |4i(0)  - 0(0^))  s for  all  0 sudi  that  IQ'QqI  ^ 

6 . Thus  for  |0-0  | s 6 , 
o o o 

OD 

♦(4>(eo))  * ♦ [ Cj(<|)(0)  - 4-(0o))"  . 

n=l 

Write  9*^(0)  for  the  special  Sill-  q^(0;  -2,  -1,  1,  2)  and  for 
fixed  X > 0 define 

^ [wj 


Then  t[(0)  and  <t'(((»(0))  are  identical  if  |0-e„|  is  sufficiently 

A O 

small.  Since 


124 


for  aiiy  ii  > 0,  it  follows  that 


il^e)  = tUCo^))  M'[x7r 


Clearly  the  function 


|<f(0)  - <}>(0^ 


is  the  Fourier  transform  of  r^(x),  say,  where 


r,(x) 


j f-  -ie^Cx-z) 


{q(X(x-z))  - q(Ax)}dB(z), 


anJ  B(x)  is  the  function  in  B(H;  v)  for  ivliich  4(6)  * B'(0), 
By  Fubini's  theorem  for  nonnegative  functions 

I*  jrj^(x)  |dx  s I*  II  |q(A(x-z))  -q(Ax)|dx|  |dB(z)  | 


llie  inner  integral 


|q(u-Azj  - q(u)|du 

J -00 


tends  to  zero  boundedly  as  A + 0.  Therefore  by  choosing  A sufficiently 
small  wc  may  suppose 
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|r^(x) |dx  < . 


Since  nC0)  is  the  product  of  a function  in  v)  and  an 

A 

SMF,  it  follows  that  t^Cx)  « L(M;  v) . Nav  set 


p'(e)  * c^  — I |4.(0J  - 


Ur 


n=l 


r^ie) 


Then 


P(x)  * I ' 


n»l 


where  the  convolutions  of  r^(x)  are  defined  as  follows; 


r*^(x)  - r^(x) 


and 


r,”(x) 


r (x-z)r/"  ^^(z)dz,  (n  * 2,3,.,.) 


In  order  to  show  that  p{x)  c l.(M;  v)  for  M(x)  c H we  make  use 
of  the  following  result: 


L£!I1A  a.  1 If  y(z)  is  analytic  in  the  disc  lz|  s r, 
L(M,  v)  for  some  M(x)  f M and  some  v 2:  0,  and  if 


if  a(x)  f 


L 


|a(x) |dx  < r, 
then  "fCalx))  < L(M;  v) . 
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PilOOF  OF  LEiSlA  A.  i.  The  prcx>f  of  Lenma  A,1  is  based  on  two  auxiliary 
letimas  given  by  Smith  (1976) : 


LLlfflA  A. 2 Suppose  a(x)  and  b(x)  bclomj  to  L(M;  v)  for  some  right 
moment  function  M(x)  and  some  v 2 0.  Then 


M(x)x^ 


)a(x)*b(x) |dx  s 


M(x)x  |a(x)|dx 


I ( r ■ 


M(x)x^  |b(x)|dx 


PROOF.  See  Smith  (1976;  page  21). 


LEIl'lA  A.  3 If  a(x)  e L(M,  v)  where  M(x)  is  a right  moment  function 
and  \>  i.  0,  then  there  exists  a function  e(x)  such  that  e(x)  + 0 
as  X ® and 


M(x)x^| a ^(x) |dx  s 


a(x)  I Jx  £(x) 


k 


for  all  k s 1. 

PROOF . See  Smith  (1976;  pages  21-22). 


We  can  find  c > 0 sucn  that 


a(x) |dx  + t < r, 


and  by  Lemma  A. 3 there  exists  a positive  integer  k^  (depending  on  e) 
such  that 
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M(x)x^  I a ’’’(x)  |dx  s |a(x)|dx 

' / -c® 


* e 


m 


for  all  m 2 k . Thus  if 
o 


= I (say) 

m=0  ™ 


and  we  define 


then 


\ (a(x))  = J a a ‘(x) 

o m=k  ^ 

o 


M(x)x''|H'j^  (a(x))  jdx  s 


00  f 1®  1**' 

1 lq_,l  j |aU)  |dx  + e[  < 


npk. 


since  the  series  Y (^s  absolutely  convergent  within  its  radius 

m*=0  ^ 

of  convergence.  But 


M(x)x''|4'{a(x))  - (a(x))|dx 


k -1 

^ I 


M(x)x  I a (x)  Idx  < oo 


by  finitely  many  applications  of  Lemna  A. 2.  Therefore  we  can  conclude 
that  'l'{a{x))  € L(M;  v) , thus  proving  Lemma  A.l. 
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N'ow  the  Fourier  transform  of  p(x)  is  given  by 


P^(9) 


OO 


I 

n=l 


c 

n 


(t.(0)  - <|>{0q) 


n 


r "f* 

and  it  follows  from  Lemna  A.  2 that  T^(0)  «'  L (M;  v) . 

So  far  wo  have  shown  that  if  0^  is  any  point  of  the  closed 
interval  J (including  the  end-points),  then  there  exists  a function 
T^(0)  e L*^(M;  v)  such  that  tCiliCG))  = ® ® closed 

sub-interval  centered  about  6^.  By  the  Meine-Borel  theorem  it  is 
possible  to  cover  the  closed  bounded  interval  J with  a finite  number 
of  these  intervals. 

Suppose  (gj,  Y2)  (62*  ^2^  overlapping 

intervals,  so  that  6^  62  ^1  ^2’  sujipose  that  T^(0)  and 

t1,(0)  are  two  corresponding  functions  in  L^(M;  v) . Then 
^2 


q*^(0. 


Bj-l,62,g2.Yi)  tJ^(0)  + q^(0; 


®2’^1  ’''^2 


,Y2*1)T;^,(0) 


belongs  to  L^(M;  v)  and  is  identically  equal  to  't>(ij>(0))  throughout 
(61 , Y2) • This  argument  may  be  continued  in  an  obvious  manner  (with 
appropriate  modifications  at  the  end-points  of  J,)  so  that  we  obtain 

•f* 

a single  function  T (0),  say,  which  belongs  to  L (M;  v)  and  is 
identically  equal  to  <'(i)>(0))  for  Bed.  In  fact,  since  ijj(0) 
vanishes  outside  J,  we  have 


i1»(0)t‘'’(0)  - iK0)4>((1)(0))  for  all  0, 
and  since  i)<(0)T^(fl)  belongs  to  L^(M;  v)  by  I.emma  A. 2,  we  have 
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<i'(.6)'*>(.<}>(0) ) ‘ v)  • This  implies  the  conclusion  in  the  first  p;irt  of 

Tlieorem  2.2. 

The  proof  of  Part  B involves  the  use  of  a result  iuialogous  to 
Lenma  A. 1 for  functions  of  bounded  variation.  Since  this  additional 
lenma  can  be  established  in  a straightforward  manner,  we  shall  omit  the 
details  for  tiie  sake  of  brevity  and  tTK'rely  outline  the  second  half  of  the 
proof  of  Tlieorem  2.2. 

Suppose  (without  loss  of  generality)  that  .1  = (n,+  “>) , and  write 

p for  p[(ii(e)l.  Since  no  singularity  of  llz)  is  within  a distance  p 

of  the  origin  by  iissun^tion,  we  can  find  an  f > 0 such  that  {-(z)  = 

00 

c for  all  lz|  < p 2e,  and  the  series  converges  absolutely 
n=0  " 

in  this  interval.  There  exists  a positive  integer  k such  that 


* aa'^’ce)  + 6B^(e)  , 

where  a^O,  6^0,  a+B=l,  a’’’(9)  t (M;  v) , B^(e)  f P*(M;  v) , 

1 k 

and  B < (p  + y e)  . (Tne  fact  that  both  a and  6 are  real  is  a 
consequence  of  assuning  that  (KG)  is  a characteristic  function.) 

For  all  |0|  > 2A,  say,  l(ti(0)|  p + c and  therefore 


4>(4>(0)) 


oo 


I 

n=0 


C^(<K0))'' 


j«0  n=0  ^ J 


"I  ((^(0))J  I c.AaaUo)  - BB^(e))" 

j«0  n^O  •' 


k-1 

■ I (<l>(e))^  H- (0)  , say. 
j-0  ^ 


I 

I 

i 
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For  0 s 2X  , 


= <(9)  = I * ua^Olq^f))”  , 

J n=0  J '' 


+ 

ami  this  series  converges  absolutely.  Since  a fo)  is  the  Fourier 
transform  of  the  L(M,  v)-function  a(x)  , it  follov\'s  that  a^(0)  - 
a (8)q'^(0/A)  is  the  Fourier  transform  of  the  tCM;  v)-function 
say,  where 


'OO 

[a(.\)  - a(x  - y)]  q(u)du, 

A 

y -OO 


using  the  fact  that 


q(u)Uu  = q (o)  = 1.  By  arguments  similar  to 


those  used  in  the  proof  of  Part  A,  we  can  show  that 


r 

|g^(x)  idx  -►  0 as  A ► «'. 


Thus  for  A sufficiently  large,  SB^(0)  + agt(0)  is  a function  of 

A 

4 k 

6'(M;  v)  whose  total  variation  is  less  than  (p  ♦ t)  . As  before,  it 

follows  that  =j  (9)  e o^(M;  v) , since  iP(z)  is  analytic  in 

I zj  < p + 2c. 

Since  {<l>(9)}'^  c 3^(M;  v)  for  every  integer  j s 0 by  Lenma  A. 2, 
it  follows  that  there  is  some  function  Tj[^(0) , say,  belonging  to 
B^(M;  v)  and  such  that 

[1  - q^(0/2A)]  4'(0)^(4>(9))  = ^^(0) 

for  all  0.  By  tnc  first  part  of  the  proof  there  is  also  a function 
T^(0J  belonging  to  8^(M;  v)  and  such  that 
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q^(0/2A)  = T^fe) 


for  all  0.  I'hus 


^(o)^«>(e))  = T^Ce) 


Tt(0)  , 3+ 


(M;  v). 


wiiich  concludes  the  proof  of  Part  B of  the  theoren. 
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real  constant the  class  of  functions  8(M;v)TConsists  of  all  functions  of 

hoanded  variation  such  that  / |x|)  |dB(x)  | < ®.  Renewal  processes  are  con 


sidered  and  it  is  supposed  the  lifetime  distribution  function  belongs  to  a class 
8fM;v);  approximations  are  then  obtained  to  varioas  moments  of  the  renewal 
count  N(t),  the  remainder  terms  bring  in  a related  8-class.  These  results  ^ 
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arc  used  to  tackle  various  questions  concerned  with  superposed 
renewal  processes. 
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